Tracing of a data processing apparatus

ABSTRACT

A trace unit, diagnostic apparatus and data processing apparatus are provided for tracing of conditional instructions. The data processing apparatus generates instruction observed indicators indicating execution of conditional instructions and result output indicators indicating output by the data processing apparatus of results of executing respective conditional instructions. The instruction observed indicators and result output indicators are received by a trace unit that is configured to output conditional instruction trace data items and independently output conditional result trace data items enabling separate trace analysis of conditional instructions and corresponding conditional results by a diagnostic apparatus. The instruction observed indicator is received at the trace unit in a first processing cycle of the data processing apparatus while result output indicator is received at in a second different processing cycle.

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention relates to data processing. More particularly, thepresent invention relates to tracing of processing activities performedby a data processing apparatus.

2. Description of the Prior Art

It is known to perform tracing of activities of a data processingapparatus in order to verify processor design and to confirm reliableoperation of the data processing apparatus when executing programinstructions.

It is known to provide a trace unit in association with the dataprocessing apparatus, the trace unit being configured to monitor theprocessing activities of the data processing apparatus and to generate asequence of trace data items indicative of those processing activities.An example of such a trace unit is the ARM Embedded Trace Macrocell(ETM) that can be provided either as part of a single System-On-Chip orindependently from the processor. The ETM generates trace data foroutput to the diagnostic apparatus. For modern data processingapparatuses running complex software, the volume of trace data generatedduring the trace operation is typically very large. Accordingly, it isdesirable to provide items of trace data in a compressed form, omittingany information that is expected to be redundant and including data thatis only strictly necessary for the particular analysis purpose. U.S.Pat. No. 7,707,394 sets out some techniques for reducing the size oftrace data stream.

Tracing of activities of a data processing apparatus can be complex in adata processing apparatus capable of out-of-order execution of programinstructions and/or speculative execution. Speculative execution is atechnique often employed in data processing apparatuses because it canimprove instruction throughput, for example, by preventing pipelinestages of a pipelined data processing apparatus from remaining idle forany significant period of time. However, speculative execution ofinstructions can present a tracing unit with particular difficultiesbecause, until the speculation is resolved, i.e. until it is knownwhether a given instruction that was speculatively executed is actuallycommitted by the data processing apparatus, the trace unit is unable toprovide a stream of trace data that definitively indicates the actualoperation of the data processing apparatus.

Known techniques for dealing with tracing in a data processing apparatuscapable of speculative execution are to buffer all of the trace dataassociated with speculatively executing instructions until thespeculation is fully resolved, or to generate and output trace dataspeculatively and to cancel certain items of the trace data if it issubsequently found that the instructions to which they corresponded weremis-speculated. For example, the Nexus protocol (“The Nexus 5001Forum-Standard for a Global Embedded Processor Debug Interface”,IEEE-ISTO 5001-2003, 23 Dec. 2003) supports cancelling a specifiednumber of trace data items. However, even if data processing apparatusspecifically indicates to the trace unit which instructions or groups ofinstructions should be cancelled, actually identifying the items oftrace data that correspond to those cancelled instructions isnon-trivial.

In a data processing apparatus capable of out-of-order executionproblems can arise in tracing the data processing activities when, forexample, dealing with execution of instructions such as load or storeinstructions, which can take many cycles to complete. Thus, for example,even when in-order processing is performed if a load instruction isexecuted and a corresponding item of trace data is generated, by thetime requested data value has been retrieved from memory system it canbe difficult to identify the corresponding item of (previouslygenerated) trace data associated with execution of the load instruction.Thus there can be a problem in correlating data values retrieved frommemory with the particular executed load instructions. It will beappreciated that this situation is exacerbated when data transfers suchas load instructions can be performed out of program order, which canmake it virtually impossible to identify which data values belong towhich memory addresses. Some background technical information regardingthe tracing of out-of-order processors can be found in the document “ThePD Trace Interface and Trace Control Block Specification”, 4 Jul. 2005(available fromhttp://www.mips.com/products/product-materials/processor/mips-architecture)and in the ARM ETM v3 architecture (available fromhttp://infocentre.arm.com).

A particular problem can arise in tracing of conditional instructionsbecause there is typically a delay between decoding of a conditionalinstruction and resolution of the particular condition attached toexecution of the instruction. Many known instruction sets only allowbranches to be executed conditionally. However, the ARM architectureuses conditional evaluation hardware that enables a variety of differentinstructions to contain a condition field that determines whether or notthe data processing apparatus will execute the correspondinginstruction. Non-executed instructions typically consume only a singleprocessing cycle. The ability to execute a number of differentinstructions conditionally removes the need for many branchinstructions. Branch instructions can stall the pipeline of a dataprocessing apparatus requiring a plurality of cycles to refill thepipeline and conditional instructions allow for dense in-line codewithout branches. The time penalty of not executing several conditionalinstructions (where the attached conditions are not satisfied) isfrequently less than the overhead of the branch instructions that wouldotherwise be needed. Accordingly, conditional instructions are veryuseful in improving the efficiency of data processing.

However, conditional instructions such as conditional non-branchinstructions present a particular problem for tracing activity of thedata processing apparatus due to the delay between decoding of theinstruction and evaluation of the attached condition. The conditionalpass/fail information could be traced at the same point as theconditional instruction and hence be traced using a single trace packet,but this requires significant buffering to support such tracing,particularly in an out-of-order processor or processor capable ofspeculative execution.

Accordingly, there is a requirement to provide a technique that offersmore efficient tracing of conditional instructions that is alsoapplicable to the tracing of instruction sequences in a data processingapparatus capable of speculative and/or out of order execution.

SUMMARY OF THE INVENTION

According to a first aspect, the present invention provides a trace unitconfigured to generate items of trace data indicative of processingactivities of a data processing apparatus, said trace unit comprising: atrace input interface for receiving from said data processing apparatusat least one instruction observed indicator indicating observation of aconditional instruction and at least one result output indicatorindicating output by said data processing apparatus of a result ofexecuting said at least one conditional instruction; and tracingcircuitry for processing said at least one instruction observedindicator and said at least one result output indicator and configuredto generate from said at least one instruction observed indicator andsaid at least one result output indicator corresponding conditionalinstruction trace data items and conditional result trace data items andto independently output said conditional instruction trace data itemsand said conditional result trace data items enabling separate traceanalysis of conditional instructions and corresponding conditionalresults by a diagnostic apparatus.

The present invention recognises that providing tracing circuitrycapable of independently outputting conditional instruction trace dataitems and conditional results trace data items provides considerableflexibility and the tracing of conditional instructions that canameliorate problems associated with known techniques of buffering tracedata until a condition associated with a conditionally executedinstruction is fully resolved.

It will be appreciated that an instruction observed indicator and acorresponding result output indicator could be output by the dataprocessing apparatus in the same processing cycle. However, in someembodiments, an instruction observed indicator is output by a dataprocessing apparatus and received at a trace input interface of tracingcircuitry in a first processing cycle whilst the data processingapparatus is configured to be capable of outputting a result outputindicator corresponding to the same conditional instruction in a seconddifferent processing cycle. This means that the instruction observedindicator and corresponding result output indicator should also bereceived at the trace input interface in different processing cycles.This facilitates separate tracing of execution of a conditionalinstruction and the corresponding subsequently generated conditionalresult. The ability to independently trace conditional instructions andtheir corresponding conditional results is useful because in some dataprocessing cores it may not be possible to trace all details of aconditional instruction at the same point in the processing pipeline.Furthermore, conditional instructions may be processed out of order insome data processors. Splitting the tracing of conditional instructionsinto two-parts according to the present technique directly addressesthis issue. This makes tracing of conditional instructions moreefficient particularly in a data processing apparatus capable ofspeculative and/or out-of-order execution.

The temporal separation of tracing of the execution of the conditionalinstruction and the output of the conditional result means that, forexample, in an out-of-order processor, a given execution sequence can betraced in different ways depending on the timing and capabilities of theparticular data processing apparatus. In particular, the time framewithin which the conditional results become available relative to thedecoding of the conditional instruction can vary significantlydepending, on the processor capabilities, yet this can be readilyaccommodated by the data processing apparatus outputting the instructionobserved indicator and the result output indicator in differentprocessing cycles.

In some embodiments, said trace unit comprises a result output indicatorbuffer for storing a plurality of sets of result output indicatorsreceived from said data processing apparatus, said trace unit beingconfigured to periodically select a stored set of results for output forprocessing to said tracing circuitry and in response to one of saidinstruction observed indicators indicating a conditional instructionreferencing a set of result output indicators that said buffer currentlystore a valid value for, said trace unit is configured to select saidcurrently stored valid set of result output indicators for output suchthat a new set or result output indicators can be stored.

It may be that the trace unit can accept many result output indicatorsin a single cycle, however, providing trace circuitry that has theability to generate that number of conditional result trace data itemswould be expensive. Thus, it may be advantageous to buffer these resultsand output them steadily. In this way peaks in the receipt of resultoutput indicators can be smoothed out. Thus, output indicators areoutput either when execution of a conditional instruction requires acurrent result output indicator to be evicted or when no items arereceived and thus, one or more items can be selected for output. As thesystem is designed to receive the instruction observed indicator inadvance of the results output indicator, it can be determined where aninstruction is to be executed that requires a storage location to storethe results that is currently used and this data from this location canbe output and the storage location is then free when the results arereceived.

In some embodiments said data processing apparatus comprises a pluralityof current program status registers configured to store a respective setof condition code flag values that are indicative of how a conditionalinstruction is processed, said buffer comprising a storage location forstoring one set of result output indicators corresponding to each ofsaid plurality of current program status registers, each of said sets ofresult output indicators comprising at least some of said condition codeflag values.

The result output indicators may for example comprise at least somecondition code flag values received from CPSR registers. If this is thecase, there is a storage location for each CPSR register and these mayall be updated in one cycle, and thus, the trace unit must be able toaccept that number of inputs. Furthermore, as conditional instructionsare executed it can be determined if there is a conditional instructionthat corresponds to a status register for which there is already a validvalue stored in the buffer. If this is the case then this value can beoutput and the storage location used to store the new value. Byoutputting the instruction observed indicator in an earlier cycle thebuffer can be cleared in advance of the new values arriving.Furthermore, by having the buffer these input values can be stored anddo not all need to be processed at the same time.

It should be noted that if M conditional instruction indicators can bereceived in a single cycle then the trace unit must be able to evict andoutput M conditional result indicators in a single cycle to free up thestorage locations if required. As noted earlier if there are N statusregisters, in some embodiments the trace unit should be able to receiveN sets of result output indicators in a single cycle. M is typicallymuch smaller than N and thus, the number of result output indicatorsoutput in a single cycle to be processed by trace generation logic isrelatively small Although the conditions associated with execution of aconditional instruction could be tracked in a number of different ways.In some embodiments, the data processing apparatus comprises at leastone current program status register configured to store a respective setof condition code flag marks that are tested to determine whether aconditional instruction should be output as items of trace data and thetrace unit comprises a data store for storing a current program statusregister table listing a state associated with the at least one currentprogram status register at least a subset of the respective set ofcondition code flag marks. This provides a convenient mechanism viawhich the trace unit can keep track of whether a given condition codefor a given conditional instruction has been resolved or is beingtraced. It enables efficient tracking of the current status of aplurality of conditionally executed instructions.

In some embodiments, the current program status register table of thetrace unit is configured to store three different states in respect ofeach of the subset of the condition code flags. However, in alternativeembodiments different number of states could be stored in respect ofeach condition code flag as required by the particular requirements ofthe tracing exercise. In embodiments where three different states arestored for each condition code flag, the three states comprise: traced;to be traced; and not traced. These three states are useful for tracingof conditional non-branch instructions.

In some embodiments the three different states are tracked bymaintaining an in-flight table having two states for each flag of eachCPSR indicating which flags should be traced when emitted by said dataprocessing apparatus and a current CPSR table storing two states foreach flag of a current CPSR indicating whether or not a conditionalinstruction is to be traced as a conditional instruction trace dataitem.

It will be appreciated that the tracing circuitry could keep track ofthe condition code flags associated with a particular conditionalinstruction in a number of different ways, but in some embodiments thetracing circuitry uses the current program status register table withinthe trace unit to determine when conditional result trace data items arerequired/expected and to keep track of which of the set of conditioncode flags should be traced.

It will be appreciated that the instruction observed indicator and theresult output indicator generated by the data processing apparatus andreceived by the tracing circuitry could be correlated in any one of anumber of different ways to link a conditional result that has beenevaluated to corresponding conditional instructions. However, in someembodiments, the trace input interface receives from the data processingapparatus an instruction tag corresponding to the instruction observedindicator and a result tag corresponding to the result output indicator.

In some embodiments the instruction tag and the result tag received bythe trace unit from the data processing apparatus are output by thetrace unit to a diagnostic apparatus. However, in other embodiments thetracing circuitry is configured to perform a tag to key conversionoperation in which the instruction tag associated with the instructionobserved indicator output by the data processing apparatus is convertedto an instruction key corresponding to the conditional instruction tracedata item output by the tracing circuitry based on the instructionobserved indicator. Similarly the result tag generated by the dataprocessing apparatus and associated with the result output indicator isconverted to a result key corresponding to the conditional result tracedata item output by the trace unit to the diagnostic apparatus. This tagto key conversion operation is performed depending upon state stored inthe current program status register table within the tracing circuitry.This tag to key conversion can be used to generate keys with a knownorder, for example sequential keys, which allows for improvedcompression or reduction of the trace and hence reduced trace bandwidth.

It will be appreciated that the tracing circuitry could outputconditional instruction trace data items such that there is a one-to-onecorrespondence between instruction observed indicators received from thedata processing apparatus and conditional instruction trace data itemsoutput by the diagnostic circuitry. Similarly there could be aone-to-one correspondence between result output indicators output by thedata processing apparatus and conditional result trace data items outputby the tracing circuitry. However, in some embodiments, the tracingcircuitry comprises trace compression circuitry configured to bufferoutput of at least one of the conditional instruction trace data itemscorresponding to a received instruction observed indicator. This islikely to be useful where the occurrence of the execution of theconditional instruction (i.e. the existence of the buffered conditionalinstruction and trace data item) can be inferred by the diagnosticapparatus from output by the trace unit of a corresponding one of theconditional result trace data items with reference to a program image ofthe program instructions being executed by the data processingapparatus. This provides a convenient mechanism via which to reduce thevolume of trace data output by the tracing circuitry and received by thediagnostic apparatus, yet does not result in a loss of any tracinginformation because the diagnostic apparatus is capable of readilyreconstructing (via an image of the executed program instructions) theoccurrence of the conditional instruction execution whose trace dataitem was buffered.

It will be appreciated that the tracing circuitry could buffer output ofthe results key corresponding to a buffered conditional instructiontrace data item, but in some embodiments the tracing circuitry isconfigured to output at least one of the results keys for a bufferedconditional instruction trace data item. The outputted result key isused by the diagnostic circuitry to infer output of the bufferedconditional instruction trace data item. This provides a convenient andreliable mechanism via which to infer existence of the bufferedconditional instruction trace data item in addition to using thecorrelation between program image maintained by the diagnostic apparatusand their received conditional result trace data items.

Not all conditional instructions have corresponding conditionalinstruction trace data items. Some conditional instruction trace dataitems are not output directly, but instead are inferred by conditionalresult trace data items. This is a trace protocol feature wherebyconditional instruction trace data items are effectively output as partof the packet corresponding to the conditional result trace data item.

It will be appreciated that the tracing circuitry could keep track ofwhich of the conditional instruction executions had associated tracedata which was buffered prior to output to the diagnostic circuitry in anumber of different ways. However, in some embodiments, the tracingcircuitry is configured to monitor and maintain a buffering recordindicating which of the received instruction observed indicators hadoutput of a corresponding conditional instruction trace data items bythe tracing circuitry buffered.

Buffering of output of a conditional instruction trace data item may bemore appropriate for some conditionally executed instructions than forother types of conditionally executed instructions. Maintaining abuffering record indicating for which instruction observed indicatorsoutput of a corresponding conditional instruction trace data item werebuffered assist the tracing circuitry in managing situations wherebuffering of conditional instruction trace data items is employed.

It will be appreciated that the buffering record could comprise avariety of different types of information with regard to buffering ofconditional trace data items. However, in some embodiments the bufferingrecord comprises a record of a most recently generated conditionalinstruction trace data item and a most recently output conditionalinstruction trace data item. This enables that tracing circuitry todetermine for each conditional result trace data item, which if anyconditional instruction trace data items can be implied from thecorresponding conditional result trace data item.

In some embodiments having a buffering record, a conditional instructiontrace data item is determined to have been buffered when a keycomparison is performed to determine if a key corresponding to theconditional instruction trace data item is greater than a keycorresponding to said most recently output conditional instruction tracedata item and is less than or equal to a key corresponding to the mostrecently generated conditional instruction trace data item.

In some such embodiments, the values of the key wrap around when amaximum value is reached and the key comparison observes moduloarithmetic.

In some embodiments where the tag to key conversion operation isemployed, this is performed such that when the tracing circuitry (ortrace unit) receives one of the instruction observed indicators from adata processing apparatus, the current program status register tablewithin the tracing circuitry is looked up using the instruction tag toidentify an appropriate one of the current program status registersstoring a relevant subset of condition code flags. This provides astraightforward mapping between the current program status registers anda given conditional instruction in terms of keeping track of which setof condition code flags are relevant to determining whether or not aparticular conditional instruction is actually executed.

In some such embodiments where the current program status register tableis looked up using the instruction tag, the tracing circuitry performsthe tag to key conversion operation by allocating a new key value to anynewly generated conditional instruction trace data item when none of therelevant subset condition code marks stored in the current programstatus register table currently indicate that they are to be traced. Onthe other hand, a repetitive key value that repeats the most recentlyallocated key value is allocated to a newly generated conditionalinstruction trace data item when one or more of the subset conditioncode marks (i.e. state entries) currently stored in the current programstatus register table indicate that they are to be traced. This providesa convenient and efficient way of matching conditional trace data itemswith corresponding result trace data items.

In some such embodiments where the instruction tag is used to look upthe current program status register table, the tracing circuitrycomprises trace compression circuitry configured to buffer output of atleast one of the conditional instruction trace data items having new keyvalues whose occurrence can be inferred by the diagnostic apparatus fromoutput from the trace unit of a corresponding one of the conditionalresult trace data items. On the other hand, conditional instructiontrace data items corresponding to one or more of the repetitive keyvalues are not buffered. This ensures that the use of the keys toperform correlation between conditional instructions and associatedconditional results remains reliable. If buffering of output of theconditional instruction trace data items is only used where there can bea unique correspondence between the key values and the particularcompressed conditional instruction trace data item this protects againstincorrect correlation between received conditional results and inferredconditional instructions.

In some such embodiments, that tracing circuitry is configured to supplythe conditional result trace data item to the diagnostic tool togetherwith an indication of whether or not one or more correspondingconditional instruction trace data items are permitted to be inferred bythe diagnostic tool. This ensures that the diagnostic tool has clearguidance with regard to where it is permissible to infer the existenceof one or more conditional instructions.

In some embodiments that are configured to buffer conditionalinstruction trace data items yet to output associated result keyscorresponding to those buffered conditional instruction trace dataitems, the tag to key conversion operation performed by the tracingcircuitry is modified in the event that a branch mispredict indicationis received by the trace unit. This allows the system to accommodatebranch mispredict events without comprising the accuracy of thecorrelation performed between the independently generated conditionalinstruction trace data items and conditional result trace data items.

In some embodiments the one or more conditional instruction trace dataitems are permitted to be inferred if a corresponding conditional resultkey is the same as a conditional instruction key currently buffered bythe buffer of the trace compression circuitry.

It will be appreciated that conditional branch instructions could betraced in the same way as conditional non-branch instructions by usingthe independently output conditional instruction trace data items andconditional result trace data items. However, in some embodiments, thetracing circuitry is configured to receive from the trace inputinterface of the trace unit trace data relating to conditional ornon-conditional branch instructions and load/store instructions and thetracing circuitry is configured to generate a first type of waypointindicator denoting that a corresponding instruction corresponds toeither a taken conditional/non-conditional branch or a load/storeinstruction and a second type of waypoint indicator denoting that acorresponding instruction corresponds to a not taken conditional branch.The ability to independently trace conditional branches and load/storeinstructions using “waypoints” and in a different way from the way thatconditional non-branch instructions are traced provides additionalflexibility in the tracing mechanism.

In some embodiments said trace unit further comprises trace resultcombining circuitry for receiving said conditional result trace dataitems generated by said tracing circuitry and for generating acompressed representation of at least some of said conditional resulttrace data items and storing said compressed representations, andcombining at least some of said compressed representations such thatmultiple compressed representations of trace data items are output ascombined trace data items.

It may be advantageous to represent the conditional result trace dataitems by compressed representations or tokens, where the most commonitems are represented by the shorter tokens. In this way if there areitems that occur often these can be represented by short tokens and astrace data items have a certain size multiple tokens can be combined tobe output as a single combined trace data item, thereby reducing thetrace data that is output but not the information that is transmitted.

In some embodiments said trace result combining circuitry is configuredto generate and store said compressed representations and on receipt ofa conditional result trace data item that cannot be compressed by saidtrace result combining circuitry to output said stored compressedrepresentations of trace data items as combined trace data items andthen to output said conditional result trace data item that cannot becompressed.

In order to be able to effectively combine the compressedrepresentations within combined trace data items it is convenient ifseveral of them are stored prior to being output such that a greaterchoice of which tokens to combine can be made and more efficientcombinations made. However, as an order of output needs to be maintainedwhen an item that cannot be represented by a token is received then thestored items need to be output, similarly if the buffer became full itwould need to be cleared by outputting the data stored.

In some embodiments the tracing circuitry is configured to receive fromthe trace input interface, trace data relating to conditional ornon-conditional branch instructions and load/store instructions and thetracing circuitry is configured to generate a first type of waypointindicator denoting that a corresponding instruction corresponds to aconditional branch predicted to be taken, a non-conditional branchpredicted to be taken or a load/store instruction and a second type ofwaypoint indicator denoting that a corresponding instruction ispredicted to be a not-taken conditional branch.

In some such embodiments that use waypoint indicators to indicate tracedata relating to conditional branch instructions and load/storeinstructions, the instruction observed indicator is used by the dataprocessing apparatus to indicate execution of conditional instructionsother than conditional branch instructions and the tracing circuitry isconfigured to output a conditional instruction trace data itemcorresponding to the instruction observed indicator of at least one ofthe first type of waypoint indicator and the second type of waypointindicator in the same trace data stream. The output of both theconditional instruction trace data items and waypoint indicators in thesame trace data stream provides a convenient mechanism via which todistinguish between conditional non-branch instructions and otherconditional instructions. Furthermore, since conditional branchinstructions are typically easier to trace than conditional non-branchinstructions it makes sense to provide a tailored mechanism for tracingof the conditional branch instructions and a different, moreappropriate, mechanism for tracing of conditional non-branchinstructions.

In some embodiments the result output indicator is used by the dataprocessing apparatus to indicate execution of a conditional instructionother than a conditional branch instruction and the tracing circuitry isconfigured to output a conditional result trace data item correspondingto the result output indicator and at least one of the first type ofwaypoint indicator and the second type of waypoint indicator in the sametrace data stream.

In some embodiments the instruction observed indicator is used by saiddata processing apparatus to indicate execution of a conditional branchinstruction and the result output indicator is used by the dataprocessing apparatus to indicate execution of a conditional instructionother than a conditional branch instruction and wherein the tracingcircuitry is configured to output a conditional instruction trace dataitem corresponding to the instruction observed indicator, a conditionalresult trace data item corresponding to the result output indicator andat least one of the first type of waypoint indicator and the second typeof waypoint indicator in the same trace data stream.

In some such embodiments the tracing circuitry is configured to output afirst type of conditional instruction trace data item corresponding toconditional instructions other than conditional branches where acorresponding instruction key is the repetitive key value and a secondtype of conditional instruction trace data item corresponding toconditional instructions other than conditional branches where thecorresponding instruction key is a new key value.

In some embodiments the tracing circuitry is configured to output afirst type of conditional instruction trace data item corresponding toconditional branches where a corresponding instruction key is therepetitive key value and a second type of conditional instruction tracedata corresponding to conditional branches where a correspondinginstruction key is the new key value.

It will be appreciated that the first type of waypoint indicator and thesecond type of waypoint indicator could be independently output by thetracing circuitry in the same way that they are individually generatedor any types of waypoint indicators (the same or different) can beconcatenated together in any order to form a packet. However, in someembodiments the tracing circuitry is configured to concatenate aplurality of waypoint indicators to form a concatenated waypointindicator for output to said diagnostic apparatus, said concatenatedwaypoint indicator comprising one of: a plurality of said first type ofwaypoint indicators; a plurality of said second type of waypointindicators; and a combination of different types of waypoint indicatorscomprising at least one of said first type of waypoint indicator and atleast one of said second type of waypoint indicator. This can reduce thetrace bandwidth associated with the waypoint indicators withoutcompromising the information content of the trace data stream.

Similarly, in some embodiments the tracing circuitry is configured toconcatenate a plurality of conditional instruction trace data items toform a concatenated conditional instruction trace data item and tooutput the concatenated conditional instruction trace data item to thediagnostic apparatus instead of outputting the plurality of conditionalinstruction trace data items. Again, this provides for reduction in thevolume of trace data output by the tracing circuitry associated with thetracing of conditional instructions without unduly compromising theoverall information content of the trace data stream. In some suchembodiments, the concatenated conditional instruction trace data itemhas a reduced trace bandwidth relative to the plurality of conditionalinstruction trace data items that would otherwise have to be output.

It will be appreciated that the tracing circuitry could output theconcatenated conditional instruction trace data items in a completelyseparate trace data stream from the concatenated waypoint indicators.However, in some embodiments, the tracing circuitry is configured tooutput at least one concatenated conditional instruction trace data itemand at least one concatenated waypoint indicator in the same trace datastream.

It will be appreciated that the tracing circuitry could cope withcancellation of execution of instructions or non-completion ofspeculatively executed or mispredicted instructions in a number ofdifferent ways in terms of managing the output of trace data associatedwith these instructions. However, in some embodiments, the tracingcircuitry is configured to output a realignment trace data item. In somesuch embodiment the realignment trace data item is output in response toreceipt from the data processing apparatus of a branch mispredictindicator. In other embodiments the realignment trace data item isoutput in response to receipt from the data processing apparatus of anabort indicator. In other embodiments the realignment trace data item isoutput in response to receipt from the data processing apparatus of anexception indicator. In other embodiments the realignment trace dataitem is output in response to receipt from the data processing apparatusof a cancel indicator. The use of the realignment trace data item inthis way provides a convenient and rapid mechanism via which thediagnostic apparatus can keep track of when filtering of received tracedata should be performed to take account of speculative execution and/orbranch misprediction and/or out of order execution.

It will be appreciated that the present technique of independentlyoutputting conditional instruction trace data items and conditionalresults trace data items in response to receipt from a data processingapparatus of a conditional result output indicator in potentially adifferent processing cycle from receipt of a conditional instructionobserved indicator could be applied in any data processing apparatuswhether or not it is capable of speculative or out-of-order execution.However, in some embodiments the tracing circuitry is configured toreceive from the data processing apparatus a cancellation indicatorindicating that one or more speculatively executed and tracedinstructions have been cancelled and the tracing circuitry is configuredto generate, in response to the cancellation indication a realignmenttrace item. The realignment trace item that is output by the tracingcircuitry informs the diagnostic tool which conditional instructiontrace data items correspond to cancelled instructions and that theseshould be discarded.

In some such embodiments where the trace unit is configured to output arealignment trace data item, the tracing circuitry is configured tooutput any conditional instruction trace data items that have beenreceived but not yet output prior to the output of the realignment tracedata item. This avoids errors arising due to buffering of certainconditional instruction trace data items or from misguided concatenationof conditional instruction trace data items generated at different timeswhere the times of generation span the output of the realignment tracedata item.

In some embodiments the tracing circuitry is configured to output anywaypoint trace data items that have been received but not yet outputprior to output of the realignment trace data item.

In some embodiments where the tracing circuitry is configured to receivefrom said trace input interface, trace data relating to conditionalbranch instructions and load/store instructions and wherein said tracingcircuitry is configured to generate a waypoint indicator denoting that acorresponding instruction corresponds to either a conditional branch ora load/store instruction and wherein the instruction observed indicatoris used by the data processing apparatus to indicate execution of aconditional instruction other than a conditional branch instruction andwherein the tracing circuitry is configured to output said conditionalinstruction trace data item associated with the instruction observedindicator and to output the waypoint indicator in the same trace datastream, the tracing circuitry is configured to output the realignmenttrace data item in response to said branch mispredict indicator suchthat the realignment trace data item is output after receipt of saidbranch mispredict indicator but before output of a subsequentlyoccurring conditional instruction trace data item or waypoint indicator.However, it is a valid alternative to output the realignment trace dataitem before the branch mispredict indicator.

In other embodiments the tracing circuitry is configured to receive fromthe trace input interface, trace data relating to conditional branchinstructions and load/store instructions and wherein the tracingcircuitry is configured to generate a waypoint indicator denoting that acorresponding instruction corresponds to either a conditional branch ora load/store instruction and wherein said instruction observed indicatoris used by said data processing apparatus to indicate execution of aconditional instruction other than a conditional branch instruction andwherein the tracing circuitry is configured to output a conditionalinstruction trace data item associated with the instruction observedindicator and the waypoint indicator in the same trace data stream, thetracing circuitry is configured to output the realignment trace dataitem in response to the exception indicator such that the realignmenttrace data item is output after receipt of said exception indicator butbefore output of a subsequently occurring conditional instruction tracedata item or waypoint indicator.

In some embodiments the conditional instruction trace data items aregenerated for a subset of said at least one instruction observedindicators depending upon contents of the current program statusregister table.

According to a second aspect the present invention provides a dataprocessing apparatus comprising: data processing circuitry forperforming data processing operations in response to execution ofprogram instructions; and a trace output interface configured toindependently output to a trace unit an instruction observed indicatorindicating execution of a conditional instruction and a result outputindicator indicating output of a result by said data processingcircuitry in response to execution of said conditional instruction.

Providing data processing circuitry capable of outputting an instructionobserved indicator associated with a conditional instruction and toindependently output the corresponding result output indicatorfacilitates separate tracing of execution of conditional instructionsand tracing of the output of the corresponding conditional results. Thisprovides a convenient mechanism via which to trace execution ofconditional instructions such as conditional non-branch instructions andreduces the buffering requirements by enabling the conditionalinstruction execution and the corresponding conditional results to beindependently traced.

In some embodiments of the data processing apparatus the instructionobserved indicator is output by said data processing apparatus in afirst processing cycle and said result output indicator is output bysaid data processing apparatus in a second processing cycle, differentfrom said first processing cycle.

In some such embodiments the data processing circuitry is configured toperform at least one of speculative execution and out-of-order executionof a sequence of program instructions. Separate tracing of conditionalinstruction execution and tracing of output of conditional results isparticularly useful where speculative execution and out-of-orderexecution is a possibility due to the complexities of correlatingconditional instructions with corresponding conditional results in suchsystems.

According to a third aspect the present invention provides a diagnosticapparatus configured to receive a trace data stream comprisingconditional instruction trace data items and conditional result tracedata items wherein said conditional result trace data items are distinctfrom said conditional instruction trace data items in said receivedtrace data stream, said diagnostic apparatus comprising: diagnosticcircuitry configured to process said conditional instruction trace dataitems and said conditional result trace data items with reference to animage of program instructions executed by said data processing apparatusin order to generate said trace data stream, said diagnostic circuitrybeing configured to use said image of program instructions to determineprogram instruction executed by said data processing apparatus.

Provision of a diagnostic apparatus capable of receiving conditionalresult trace data items which are distinct from conditional instructiontrace data items in a received trace data steam provides for moreefficient tracing of conditional instructions. Furthermore, the abilityof the diagnostic circuitry to make use of an image of programinstructions executed by a data processing apparatus and to determineprogram instructions executed by the data processing apparatus, even incases where there is not a one-to-one correspondence between conditionalinstruction trace data items and conditional result trace data items.This improves the capacity of the diagnostic apparatus to cope withcompressed trace data streams by providing it with the ability to deducethe existence of conditional instruction trace data items via ananalysis of conditional result trace data items with reference to theimage of the program instructions.

In some embodiments of the diagnostic apparatus according to the presentinvention, the diagnostic apparatus is configured to receive from atrace unit in a trace data stream, waypoint trace items each indicatingthat one of a branch instruction, a load instruction and a storeinstruction has been executed by the data processing apparatus. Thetrace data stream received by the diagnostic apparatus additionallycomprises conditional instruction trace data items and conditionalresult trace data items and the received ordering of the waypoint traceitems and the conditional instruction trace data items differs from anexecution ordering of the corresponding waypoint instructions andconditional instructions.

In some such embodiments the diagnostic apparatus comprises a waypointbuffer for buffering received waypoint trace items and a conditionalinstruction buffer for buffering the received conditional instructiontrace items. This makes it simpler for the diagnostic apparatus toresolve an appropriate ordering of the waypoint trace items and theconditional instruction trace data items and to reconcile the receivedordering with an ordering implied by the image of the programinstructions that is analysed by the diagnostic circuitry.

In some such embodiments the diagnostic circuitry is configured topermute the received ordering to obtain the execution ordering byindependently analysing entries in the waypoint buffer and entries inthe conditional instruction buffer with reference to the programinstruction image.

In some embodiments of the diagnostic apparatus according to the presenttechnique, if the diagnostic circuitry encounters a conditionalinstruction in the program image but a conditional instruction traceitem is not currently present in the conditional instruction buffer thenthe diagnostic circuitry is configured to delay further processing ofthe corresponding execution thread of the program image until theconditional trace item appears in the conditional instruction buffer.This ensures efficient correlation between the sequence of instructionsin the program image and the information received by the diagnosticcircuitry. This provides the diagnostic circuitry with the flexibilityto cope with receipt and analysis of a compressed trace data streamwhich some of the trace information must be reconstructed with referenceto the program image.

According to a fourth aspect the present invention provides a method ofgenerating items of trace data indicative of processing activities of adata processing apparatus based on information received from said dataprocessing apparatus, said method comprising: receiving from said dataprocessing apparatus at least one instruction observed indicatorindicating execution of a conditional instruction and at least oneresult output indicator indicating output by said data processingapparatus of a result of executing said at least one conditionalinstruction; processing said at least one instruction observed indicatorand said at least one result output indicator and configured to generatefrom said at least one instruction observed indicator and said at leastone result output indicator corresponding conditional instruction tracedata items and conditional result trace data items and to independentlyoutput said conditional instruction trace data items and saidconditional result trace data items enabling separate trace analysis ofconditional instructions and corresponding conditional results by adiagnostic apparatus.

According to a fifth aspect the present invention provides a method ofgenerating within a data processing apparatus, items of trace dataindicative of processing activities of a data processing apparatus, saidmethod comprising: performing data processing operations in response toexecution of program instructions; and independently outputting to atrace unit an instruction observed indicator indicating execution of aconditional instruction and a result output indicator indicating outputof a result by said data processing circuitry in response to executionof said conditional instruction.

According to a sixth aspect the present invention provides a diagnosticmethod for processing trace data generated by a data processingapparatus, said method comprising: receiving a trace data streamcomprising conditional instruction trace data items and conditionalresult trace data items wherein said conditional result trace data itemsare distinct from said conditional instruction trace data items in saidreceived trace data stream; processing said conditional instructiontrace data items and said conditional result trace data items withreference to an image of program instructions executed by said dataprocessing apparatus in order to generate said trace data stream; andusing said image of program instructions to perform a correlationbetween said conditional instruction trace data items and saidconditional result trace data items to determine processing stepsperformed by said data processing apparatus.

Further aspects and features of at least embodiments of the presentinvention are defined in the appended claims. Features of the dependentclaims may be combined with features of the independent claims asappropriate, and in combinations other than those explicitly set out inthe claims.

The above, and other objects, features and advantages of this inventionwill be apparent from the following detailed description of illustrativeembodiments which is to be read in connection with the accompanyingdrawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 schematically illustrates a data processing system according toan embodiment of the present invention;

FIG. 2 schematically illustrates Current Program Status Register tableof the of the trace unit of FIG. 1 in more detail;

FIG. 3A is a table that schematically illustrates tracing and markingassociated with execution of a sequence of four program instructions;

FIGS. 3B, 3C and 3D are tables showing which CPSR values are traced andwhich c-results keys are generated when exactly the same sequence offour instructions as in the table of FIG. 3A is executed out-of-orderrather than in-order;

FIG. 4 is a state machine that schematically illustrates the three stateCPSR flags for the CPSRs 150 of FIG. 1

FIG. 5 is a table that schematically illustrates execution of threeconditional instructions (ADDEQ, ADDNE, ADDVS) where the conditionalresults are evaluated after decoding of the third conditionalinstruction and shows the conditional result payload and the CPSR tableactions corresponding to each instruction decode stage;

FIG. 6A is a table that schematically illustrates a case where updatesfor a conditional instruction tag B must not cause a new c-atom key tobe generated for an ADDNE instruction immediately following instructioncancellation events;

FIG. 6B is a table that schematically illustrates that, in contrast tothe situation in FIG. 6A, it is not always correct to use the samec-atoms key after conditional instructions are cancelled;

FIGS. 6C, 6D and 6E describe an alternative technique to the techniquedescribed with reference to FIGS. 3A to 3D, in which a two-state CPSRtable is maintained;

FIGS. 7A to 7D are tables that schematically illustrates how waypointand c-atoms are handled within that same trace data stream;

FIG. 8 is a flow chart that schematically illustrates actions taken bythe diagnostic circuitry of FIG. 1 upon receipt of a trace data streamcontaining both conditional atom packets and waypoint packets;

FIGS. 9A to 9C are tables that schematically illustrate concatenation ofwaypoints and conditional instruction trace data items;

FIG. 10 is a flow chart that schematically illustrates actions taken bythe diagnostic circuitry of FIG. 1 to analyse incoming trace data;

FIGS. 11A to 11C schematically illustrate the relative positioning of arealignment trace data item in a trace data stream;

FIGS. 12A and 12B are tables that schematically illustrate howconditional instruction execution is implied based on conditional resulttrace data;

FIG. 13 is a table that schematically illustrates a trace data sequencesimilar to the sequence of FIG. 12B, but in which the values stored inthe “last-c-atom-generated-key” register and the“last-c-atom-output-key” register are shown;

FIG. 14 a is a flow chart that schematically illustrates actions of theETM of FIG. 1 in outputting the trace stream and implementing a tracecompression scheme where certain c-atoms are generated but buffered;

FIG. 14 b schematically illustrates a trace unit according to anembodiment of the present invention;

FIG. 15 schematically illustrates a processing apparatus, trace circuitand diagnostic apparatus;

FIG. 16 illustrates examples of condition flags and condition statesused in the processors designed by ARM Limited of Cambridge, UK;

FIG. 17 illustrates an example of identifiers for identifying particularsets of values of the condition flags;

FIG. 18 illustrates a method of tracing the values of condition flagsupon execution of a condition updating instruction;

FIG. 19 illustrates a corresponding method of analysing trace datagenerated in the method of FIG. 18;

FIG. 20 illustrates an example of a trace stream generated in the methodof FIG. 18 and an example of the analysis of the trace stream accordingto the method of FIG. 19;

FIG. 21 illustrates an example of a sequence of program instructions inwhich multiple condition updating instructions occur in successionwithout any intervening conditional instructions;

FIG. 22 illustrates a method of tracing the values of the conditionflags upon execution of a conditional instruction;

FIG. 23 illustrates a corresponding method of analysing trace dataproduced in the method of FIG. 22;

FIG. 24 illustrates an example of a trace stream generated in the methodof FIG. 19 and an example of the analysis of the trace stream accordingto the method of FIG. 20;

FIG. 25 illustrates a method of tracing the values of at least arequired subset of condition flags upon execution of a conditionalinstruction;

FIG. 26 illustrates a corresponding method of analysing trace datagenerated in the method of FIG. 25; and

FIG. 27 illustrates an example of generating a trace stream using themethod of FIG. 25 and an example of analysing the trace stream using themethod of FIG. 26.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

FIG. 1 schematically illustrates a data processing system according toan embodiment of the present invention. The data processing systemcomprises: an instruction memory 90; a central processing unit (CPU)100; an embedded trace macro cell (ETM) 180 containing tracing,circuitry; and diagnostic circuitry 196 for analysing output of theembedded trace macro cell 180.

The central processing unit 100 comprises: an instruction fetch unit110; a pipeline 120 including a decode stage 122; a set of registers130; an arithmetic logic unit (ALU) 140; a set of current program statusregisters (CPSR) 150; a memory interface 160; an instruction outputinterface 172; and a results output interface 174.

The instruction fetch unit 110 fetches instructions from a computerprogram 92 stored in the instruction memory 90 and supplies thosefetched instructions to the decode stage 122 of the pipeline 20. The CPUcentral processing unit 100 illustrated in FIG. 1 is an ARM pipelineddata processor. The pipeline 120 allows several operations associatedwith execution of program instructions to be undertaken substantiallysimultaneously rather than serially and thus increases throughput ofinstructions. The instruction fetch stage performed by the instructionfetch unit 110 can be considered to be an integral part of the pipeline120. The decode stage 122 of the pipeline 120 involves decoding ofregisters from the register bank 130 that are to be used for executionof the particular instruction that has most recently been fetched. TheCPU 100 is configured to perform speculative execution and out-of-orderexecution of program instructions.

Following the decode stage, the instruction proceeds to an execute stageof the pipeline (not shown) where registers from the register bank 130are read and the arithmetic logic unit 140 is used to execute theinstruction. A final stage of the pipeline 120 involves writing back tothe register bank result(s) of the execution of the instruction.

The CPU 100 comprises the register bank 130, which has a plurality ofregisters each having a fixed-length. The register bank 130 incorporatesa set of general purpose registers for use during execution of theprogram instructions. Note that ARM data processing instructions such asarithmetic operations, comparisons, logical operations and data movementoperations work only on registers and not in memory, because the ARMarchitecture is a load/store architecture. Also contained within theregister bank 130 is a dedicated program counter (not shown) thatindexes a program instruction currently being fetched. Further registersincluded within the CPU are a set of dedicated current program statusregisters (CPSR) 150 and a set of dedicated saved program statusregisters (SPSR) (not shown). In the FIG. 1 embodiment, Register R14 ofthe register bank 130 is the link register whilst register R15 is theprogram counter. Specific instructions allow access to the currentprogram status registers (CPSRs) 150. The current program statusregisters 150 each comprise a set of four condition code flags Z, V, Cand M. These will be described in more detail with reference to FIG. 2below.

In addition to the four condition code flags, the CPSRs 150 furthercomprise “mode bits” that define the current processor mode andinterrupt disable bits. The link register R14 of the register bank 130stores the return address for when so-called “Branch with Link” programinstructions are executed. The return address is calculated from theprogram counter in R15. To enable execution flow of a program to returnfrom a linked branch, the contents of the link register R14 are copiedinto the program counter register R15. The current values of the flagsZ, V, C and M, which are stored in the CPSRs correspond to certainconditions used to determine whether or not conditionally executedinstructions should be executed. Whilst most instruction sets allow onlybranch instructions to be executed conditionally, the ARM architectureallows many instructions to be conditionally executed because many ARMinstructions contain a condition field that determines whether or notthe CPU 100 will execute them.

The contents of the CPSRs 150 are used to assess whether or not acondition specified by an instruction's condition field has beensatisfied. The ability to execute any kind of instruction conditionallyallows for very dense in-line code without branches. The removal of theneed for inclusion of many branch instructions in program code makesinstruction execution more efficient because branches simply typicallystall the pipeline 120. The time penalty of not executing severalconditional instructions (where the specified condition is notsatisfied) is typically less than the overhead of the branch instructionor subroutine call that would otherwise be required. To execute aninstruction conditionally, the instruction is simply post-fixed with theappropriate condition. For example, in the ARM instruction set, anon-conditional ADD instruction takes the form “ADD r0, r1, r2”, but toexecute this conditionally on the condition that the zero flag Z is set,this instruction can be changed to “ADDEQ r0, r1, r2”. The memoryinterface 160 is used to load data from and store data to memory.

As shown in FIG. 1, a first path 123 is provided from the decode stage122 of the pipeline 120 to the instruction output interface 172 of theCPU 100 and to the instruction input interface 182 of the ETM 180.Typically conditional instructions are traced from the decode stage 122of the processor, whilst the corresponding conditional results aretraced from the ALU 140. A second path 152 connects the CPSRs 150 of theCPU 100 to the results output interface 174 of the CPU 100 and in turnto the results input interface 184 of the ETM 180. There is also a pathconnecting the CPSRs 150 to the pipeline 120. Thus it can be seen thatthe CPU 100 has one output interface 172 for conditional instructionsand a further different output interface 174 for the correspondingconditional results 174. It will be appreciated that not allinstructions will be conditional instructions, but the embodiment ofFIG. 1 is particularly focusing on illustration of execution and tracingof conditional instructions.

The embedded trace macro cell 180 is a trace unit that providesreal-time instruction trace and data trace for the CPU 100. The ETM 180generates trace information that is used by the diagnostic circuitry 196to reconstruct the execution of all or part of the computer program 92stored in the instruction memory 90. The ETM 180 comprises both aninstruction interface 182 for receiving conditional instruction observedindicators from the CPU 100 and a results interface 184 for receivingthe corresponding conditional result indicators from the CPU 100. Theindication of an instruction will not in general indicate that itdefinitely will execute because the indication may be taken from anearly stage of the pipeline and it will not be known until manyprocessing cycles later if the instruction will fully execute. The CPU100 independently outputs conditional instruction observed indicatorsvia the instruction interface 172 and conditional result outputindicators via the trace results interface 174. A given conditionalinstruction observed indicator is output in a first processing cycle ofthe CPU 100, whilst the corresponding conditional result outputindicator is output in a second, different processing cycle of the CPU.Accordingly, the timing of receipt of conditional instruction observedindicators from at the instruction interface 182 of the tracingcircuitry 180 is different from the timing of receipt of thecorresponding conditional result output indicators at the resultsinterface 184. The CPU 100 outputs both the conditional instructionobserved indicators and conditional result output indicators withassociated “tags” identifying the particular register within the CPSRs150 associated with the conditional instruction in question.

For each conditional instruction, the corresponding conditional resultoutput indicator contains a payload that allows the diagnostic circuitry196 to determine the pass/fail status of the conditional instruction.This payload is one of

-   -   1. a pass/fail result;    -   2. a partial CPSR value;    -   3. a full CPSR value (note that some implementations will never        output a partial CPSR value); and    -   4. some other output.

Note that not all conditional instructions have a corresponding traceoutput, rather, only a subset of conditional instructions have acorresponding trace output (conditional result output indicator). If aninstruction observed indicator is output by the CPU instructioninterface 172 corresponding to a given conditional instruction then theETM 180 generates a so-called “c-atom” in relation to that conditionalinstruction and the c-atom corresponds to a trace output (instructionobserved indicator output by CPU 100) of the conditional instruction.When a corresponding conditional result output indicator is output tothe results interface 184 via the results output interface 174 of theCPU this is denoted a “c-result”. Thus the ETM instruction interface 182receives conditional instruction observed indicators and theircorresponding tags (typically, but not always, identifying associatedCPSR 150 registers) whilst the ETM results interface 184 receivesconditional result output indicators and their corresponding tags.

The ETM 180 comprises instruction key translation circuitry 186 thatreceives input form the ETM instruction interface 182 and is configuredto convert the conditional instruction observed indicator and thecorresponding tag to a c-atom. Similarly, the ETM 180 comprises resultskey translation circuitry 188, which is connected to the ETM resultsinterface 184 and is configured to convert the conditional result outputindicators and the corresponding tags received from the resultsinterface 184 to c-results and corresponding keys. The conditionalinstruction observed indicators received by the ETM instructioninterface 182 comprise both a tag representing an associated CPSRregister of the CPU and a condition type such as EQ (equal to), MI(minus) or LT (less than). The conditional results output indicatorsreceived via the ETM results interface 184 comprise associated tags(again usually representing an associated CPSR register of the CPU 100)and a results payload. The tag system is used by the CPU 100 to keeptrack of which instruction observed indicator (c-atom) corresponds towhich result output indicator (c-result). The instruction keytranslation circuitry 186 and result key translation circuitry 188convert the core tags to trace keys, which follow a pre-definedsequence, by using a table of trace keys indexed by the core tags. Sinceit is possible that trace keys may clash when conditional result outputindicators are evaluated late, special keys are used to resolve thisissue. When keys are renamed to be sequential there is a possibilitythat the next sequential key is the same value as an earlier instructionexecution indicator (c-atom) for which the result output indicator(c-result) has not yet been output. In this case the sequential key isnot used because to do so would result in two result output indicatorshaving the same key for different instruction execution indicators.Instead, a special key is used with a value that is never used as asequential key. There is a 1:1 mapping between special keys and tags.For example, if there are 8 tags there could be 16 sequential keys and 8special keys.

Output of the instruction key translation circuitry 186 is supplied tofirst trace generation circuitry 190 which converts the incoming c-atomsand corresponding keys to packets of instruction trace data. Similarly,the results key translation circuitry 188 supplies c-results andcorresponding keys to the second set of trace generation circuitry 192,which generates conditional results trace packets as output. Both theconditional instruction trace packets (comprising packetised c-atoms andassociated keys) and the conditional result trace packets (comprisingpacketised c-results and corresponding keys) are output to a FIFO 194for storage. Data stored in the FIFO 194 is supplied to the diagnosticcircuitry 196. The two sets of key translation circuitry 186, 188effectively translate core tags (identifying associated CPSR registersfor conditional instructions and results) to tracing circuitry keys in atype of renaming operation. This will be described in more detail belowwith reference to some specific examples.

The diagnostic circuitry 196 uses the received trace data to reconstructexecution events in the CPU 100. In order to do so, the diagnosticcircuitry 196 has access to a computer program image 199 correspondingto a replica of the computer program 92, instructions of which are beingexecuted by the CPU 100. Use of this program image 199 allows thediagnostic circuitry to analyse the program code to determine, forexample, where in the sequence of instruction execution branchinstructions occur. On receipt of the trace data, the diagnosticcircuitry 196 stores the conditional instruction trace data(corresponding to instruction observed indicators output by CPU 100) ina c-atom FIFO 197 and stores trace data specifically related toconditional branch instructions and conditional load/store instructionsin a waypoint FIFO 198. As will be described below, “c-atoms” are usedto trace all conditional instructions except for conditional branchesand “waypoints” are used to trace conditional branches or unconditionalload/store instructions. However, in some cases, for example forconditional load/stores, a single instruction is both a waypoint and ac-atom.

As shown in FIG. 1, the ETM 180 comprises a corresponding CPSR table 193and the diagnostic circuitry 196 also comprises a CPSR table 200. Thesetwo CPSR tables 193, 200 are used to track which CPSR results should betraced when instructions are executed out of order. In somecircumstances, multiple CPSR values will be traced in order to follow asingle flag setting instruction. An example CPSR table 193 isillustrated in more detail in FIG. 2. Note that the CPSR table 193 (seeFIG. 2) comprises CPSR state entries (or CPSR flag marks) rather thanthe condition code flags as used by the processor.

As shown in FIG. 2, the CPSR table 193 is configured to store a two-bit(three state) value in relation to each CPSR condition code flag. Thefour CPSR condition flags are the Z-flag, the V-flag, the C-flag and theN-flag. The Z-flag indicates a zero result from an ALU flag; the V-flagindicates an ALU operation overflow occurred during execution of theinstruction; the C-flag indicates that the ALU operation resulted in acarry, for example the result comprised a number of bits in excess ofthe register-width; and the N-flag indicates that there was a negativeresult (minus sign) from the ALU flag.

In the CPSR table 193 of FIG. 2, there are markers corresponding tothree different states. The states are as follows:

1. Bit-value 00 not traced and not marked;

2. Bit value 01 to be traced and marked; and

3. Bit value 11 traced and marked.

The states stored in the CPSR Table 193 of the ETM are used by theinstruction key translation circuitry 186 and the result key translationcircuitry 188 to determine when the next trace key in a sequence shouldbe generated and applied in the tag to key conversion process. Recallthat the core tags that are output together with both the conditionalinstruction and the conditional result typically identify the particularCPSR being used by that particular instruction, in this case one of thesix possible CPSR registers: CPSR A; CPSR B; CPSR C; CPSR D; CPSR E orCPSR F. Furthermore one of the four possible flag states (Z, V, C or N)for each of the six CPSR registers is specified. Also stored in thetable are key values used when instruction trace data is generated. Whena result trace data is generated a lookup is made in the table todetermine the key to be used.

FIG. 3A is a table that schematically illustrates in-order execution ofa sequence of four program instructions including three differentconditional add instructions: ADDEQ; ADDNE; and ADDVS. The example ofFIGS. 3A to 3D shows that two different CPSR condition code flags (i.e.flag marks) are traced in a CPSR table, which stores only a single statein relation to each CPSR value

In the table of FIG. 3A, the first instruction executed is a comparisoninstruction CMP, which results in all marker bits being cleared to zerobecause the comparison is the operation upon which the result of whichthe subsequent conditional instructions depend. That is, execution orotherwise of the subsequent three conditional instructions depends onthe execution result of the CMP. The first conditional instruction is anADDEQ instruction, which is an addition operation dependent upon whetherthe comparison resulted in an exact equality. This conditionalinstruction uses the Z flag of the CPSR and thus the Z marker in theCPSR table is set to one upon execution of the add ADDEQ instruction.Thus the CPSR including the Z flag is traced. Next an ADDNE instructionis executed, which also uses the Z flag since it corresponds to an addoperation being performed only if the outcome of the comparison is aninequality. Thus upon execution of the ADDNE instruction by the CPU 100(see FIG. 1), the marker bits are unchanged. Finally an ADDVSinstruction is executed that uses the V flag of the CPSR correspondingto overflow, so that when this instruction is executed, the V marker isset to one and the Z marker remains set. Thus at the end of theexecution of the four instructions of FIG. 3A, the CPSR 150 is tracedincluding both the V flag and the Z flag.

FIGS. 3B, 3C and 3D are tables showing which CPSR values are traced andwhich c-results keys are generated when exactly the same sequence offour instructions as in the table of FIG. 3A is executed, but executedout-of-order rather than in-order. In this case there are threedifferent possible outcomes depending upon the timing and thecapabilities of the executing CPU 100. In the table of FIG. 3B theconditional results are available quickly and thus a different trace keyis used for the second c-atom. All three add conditional instructionshave the same conditional instruction tag in the FIG. 3B case becausewhether or not they are conditionally executed all depends on theoutcome of the same comparison instruction CMP (first instruction of thesequence of four). A c-atoms keys of “0” is generated when the firstconditional add instruction, the ADDEQ is encountered, because thisdepends on the Z-flag. No new c-atoms key is generated for thesubsequent ADDNE instruction because this depends on the same Z-flag asthe preceding instruction. However a second c-atom key of “1” isallocated to the ADDVS instruction, which depends upon a different CPSRflag i.e. the V-flag. The conditional result for the first conditionalinstruction (ADDEQ) instruction becomes available in the cycleimmediately after decoding of the ADDEQ as shown in the FIG. 3B tableand this conditional result tag of A was converted to a C-result key ofzero whose payload is the Z flag. The conditional result of the ADDVSinstruction becomes available in the cycle immediately after theinstruction is decoded and this results in generation of a secondc-result key having a value of “1” and a payload of the V flag.

FIG. 3C shows execution of the same four instructions of FIG. 3A in anout-of order processor where the conditional results take longer toevaluate (due to capabilities of CPU 100) than in the case of FIG. 3B.In this case, the first conditional result tag output the cycle afterdecoding of the ADDVS instruction (fourth instruction in the sequence offour). Accordingly, in this case, the same c-result key of “0” is usedfor both the c-atom corresponding to the ADDEQ instruction (uses Z flag)and the c-atom corresponding to the ADDVS (uses V flag) instructionbecause they will both share a single c-result key of “0” having apayload of both the Z flag and the V flag.

The table of FIG. 3D is a final example for out-of order executionoutcome for the instruction sequence of FIG. 3A. In this case theconditional results become available in the out-of-order processor aftertwo later instructions (CMP and SUBEQ) outside the sequence of four(CMP, ADDEQ, ADDNE, ADDVS) are fully resolved by the CPU 100. Aconditional instruction tag for the SUBEQ instruction is “B” whereas theconditional instruction tag for the three preceding conditionalinstructions (ADDEQ, ADDNE, ADDVS) is “A”, reflecting the fact that thecondition upon which these three instruction depend is the first CMPwhereas the condition upon which the SUBEQ depends is the second CMP. Itcan be seen that the conditional result tag B precedes the conditionalresult tag A and thus the conditional instruction SUBEQ is fullyresolved prior to resolution of the preceding three conditionalinstructions having the conditional instruction tag A. Note that eachtime a CMP instruction is decoded (instruction upon which otherconditional instructions depend) there is a change to the CPSR and ahence a there is a corresponding change to the conditional instructiontag. Thus, in the table of FIG. 3D, the result for the conditionalinstruction tag “A” arrives after (i.e. in a subsequent processing cycleto) the conditional result for the conditional instruction tag “B”. Thepayload of the conditional result B is the Z flag whereas the payload ofthe conditional result tag A is both the Z flag and the V flags.

The separate tracing of conditional instructions and the conditionalresults according to embodiments of the present invention enables betterthroughput of trace results. This is apparent from FIG. 3D, because inpreviously known systems trace data items associated with all five ofthe conditional instructions in the table of FIG. 3D would have to bebuffered until the conditional result tagged by “A” was ready foroutput. By way of contrast, according to embodiments of the presentinvention, the c-atoms and keys corresponding to all four instructionscan be output as they are generated since c-atoms and corresponding keyscan be output in different processing cycles. The ETM CPSR table 193 isused to determine when c-results are required (corresponding to receivedC-atoms) and which CPSR flags should be traced.

This technique is useful in reducing the number of flag values tracedwhen the CPU 100 is configured to be able to calculate partial CPSRvalues and to resolve conditional instructions even when not all of theCPSR flags are known. A partial CPSR result is one where not all of theflags in the CPSR are known. For example, an ADDEQ instruction onlyneeds the Z flag to be resolved, so a partial CPSR result containing theZ flag is sufficient to resolve the result for the conditionalinstruction. It can be seen in the examples of FIGS. 3B, 3C and 3D, fromthe “c-result key” column and the “c-atoms key” column that in somecases the next trace key value in the sequence is used whereas in othercases the same trace key value is used corresponding to differentconditional instructions. In order to determine when the next trace keyin a sequence should be used, the states stored in the CPSR table areused. When a c-atom is generated corresponding to an instruction(indicating that execution of that instruction by the CPU 100 hascommenced) then the flag states of the CPSR are looked up using theconditional instruction tag as an index because the tag identifies theparticular CPSR associated with that conditional instruction. TheCurrent Program Status Register marked bits are looked up and used asdescribed below with reference to FIGS. 22 and 25. There are differentsets of bits for each CPSR.

Returning now to the first embodiment of FIGS. 3B, 3C and 3D, the ETMCPSR table 193 stores the three states: (i) not traced; (ii) to betraced; and (iii) traced. In this embodiment, in order to determine whenthe next trace key (c-atoms key) in the sequence should be used, thestates stored in the CPSR table 193 are used and when a c-atom isgenerated by the ETM instruction key translation circuitry 186, the flagstates are looked up using the corresponding conditional instruction tag(generated by the CPU) as an index. The manner in which trace keys areallocated is summarised in the table below.

FLAG STATES VALUE ACTION None of flag states are Use next trace keyvalue “to be traced” One or more flag states are Use same trace keyvalue as for most recent “to be traced” Conditional instruction tracedata item (c-atom)

As shown in this table, when none of the flag state values are indicatedas “to be traced” in the ETM CPSR table 193 then a next trace key value(c-atoms key) in the sequence is allocated. Whereas if one or more ofthe flag states of the particular CPSR corresponding to the c-atom tagare “to be traced” then the same trace key value (c-atoms key) is usedas for the most recent c-atom.

FIG. 4 is a state machine that schematically illustrates the three stateCPSR state flags for the CPSRs 150 of FIG. 1. The system is first resetand then at stage 410 a given CPSR state flag is set to a “not traced”state. In the event that a conditional atom is traced which correspondsto the given CPSR and requires the associated CPSR state flag then theCPSR state flag changes for “not traced” state 410 to a “to be traced”state 420. The CPSR state flag remains in this state until a conditionalresult corresponding to the given CPSR and including the associated flagis traced whereupon, the given CPSR state flag changes to a “traced”state 430. The CPSR state flag remains in this traced state 430 until aflag setting instruction corresponding to the given CPSR is observed, inwhich case a transition is made from the “traced” state 430 back to the“not traced” state 410.

The table of FIG. 5 revisits the example of FIG. 3C above, i.e. theexecution of three conditional instructions (ADDEQ, ADDNE, ADDVS) wherethe conditional results are evaluated after decoding of the thirdconditional instruction. FIG. 5 is an example of the three state systemof FIG. 4. The table if FIG. 5 shows, in addition to the conditionalinstruction tag, c-atoms key and conditional result tag (also shown inFIG. 3C), the conditional result payload (second column from right), theCPSR table actions corresponding to each instruction decode stage(right-most column).

Looking at the entries in the FIG. 5 table, upon decoding of the CMPinstruction (whose execution result determines whether conditionsattached to the subsequent three conditional instructions are satisfied)all states for tag A are set to “not traced”. Next, upon decoding of theADDEQ instruction, the conditional instruction tag A is output and ac-atoms key of “0” is output, then in the ETM CPSR table 193, “CPSR A”is looked up (see FIG. 2) and it is seen that none of the four flags are“to be traced” so a new group is started. A c-atom is required becausethe state of the flag Z for tag A (CPSR A) was set to be “not traced”.Next, due to decoding of the conditional instruction ADDEQ, the state offlag Z for tag A is set as “to be traced”. Upon decoding of the ADDNEinstruction (consecutively to the decoding of ADDEQ), since thisinstruction will be conditionally executed based upon the oppositecondition (not equal to) relative to the condition attached to the ADDEQinstruction (equal to), this will also depend on the condition code flagZ, which has already been tagged at the preceding decoding stage.Accordingly, the state of flag Z from tag A is already set “to betraced” and no new c-atom is required. Recall that a new trace key valueis only used if none of the flags of the relevant CPSR are set to betraced.

When the ADDVS instruction is in the decode stage a further c-atoms keyof “0” is output because the Z flag is already set “to be traced” and anew group has not started. However, a c-atom is required in this case(unlike the case of the ADDNE instruction) because the state of flag “V”for tagged CPSR A was not previously set “to be traced”. Accordingly,the state of flag V for CPSR A (se FIG. 2) is set “to be traced”. Next,the CPU 100 indicates that the flag Z is valid but the flag V is notvalid. However, it is known by looking at CPSR table 193 that both the Zand V flags are required to resolve the three preceding conditionalinstructions (ADDEQ, ADDNE, ADDVS), so the conditional result cannot yetbe traced in full. When a conditional result becomes available,indicated by the output of the conditional result tag A, which has aconditional result payload of both the Z and V flags, the CPU 100indicates that both the Z and the V flags are valid. The ETM CPSR table193 tells us that these two flags are all that is required in order totrace the conditional results can. Accordingly, the state of Z and Vflags for tag A (CPSR A) are set to the “traced” state. Note that the Zand V flags both need to be valid to trace the conditional results.

A look up of the ETM CPSR table 193 is necessary to ensure that thecorrect c-atom and c-result correlation can be achieved after a cancelinstruction is issued by CPU 100. FIGS. 6A and 6B are tables providingexamples of whether or not a new group (i.e. a new c-atoms key) shouldbe started for the three state CPSR flag system of FIG. 4. The table ofFIG. 6A schematically illustrates a case where updates for a conditionalinstruction tag B must not cause a new c-atom key to be generated for anADDNE instruction immediately following instruction cancellation events.In the table of FIG. 6A, when the ADDEQ instruction is in the decodestage, the Z-bit flag for tag A (CPSR A) is set “to be traced”. A secondCMP instruction following a branch instruction (third instruction inFIG. 6A table) results in a different CPSR (i.e. CPSR B) so conditionalinstruction tag B is allocated to the following conditional instructionSUBEQ. Furthermore, a different c-atoms key is generated for SUBEQbecause none of the flag states corresponding to CPSR B are currentlyset “to be traced”. The conditional result tag for conditionalinstruction tag B is output in the cycle subsequent to decoding of theSUBEQ instruction, so a c-result key of “1” is output, matching theSUBEQ c-atoms key of “1”.

Next in FIG. 6A, the instructions CMP and SUBEQ are both cancelled,although the associated c-result key and the c-atoms key of “1” arestill present in the trace stream. However, when the ADDNE instructionis decoded, the conditional instruction tag returns to a value of A(previously used for ADDEQ) and a c-atoms key of “0” (i.e. not a newkey) is required because this ADDNE instruction is still associated withthe most recent non-cancelled comparison operation CMP which correspondsto the conditional instruction tag A.

FIG. 6B shows an alternative example that illustrates, in contrast tothe situation in FIG. 6A, it is not always correct to use the samec-atoms key after conditional instructions are cancelled. In the exampleof FIG. 6B, if the ADDNE instruction (decoded after the mispredictedbranch cancellation) did not start a new key then its result,corresponding to conditional result tag B, would apply to both the ADDNEand the ADDEQ instructions, which is incorrect because they are bothassociated with different “CMP” instructions. The difference between thetable of FIG. 6B and the table of FIG. 6A is in the case of table ofFIG. 6B, the second CMP was not cancelled (only the branch instructionand any instructions after the branch prior to receipt of thecancellation request are cancelled) so a new conditional instruction tagand a new c-atoms key is in fact required in this case. In FIG. 6B thereis a non-conditional instruction “SUB” after the branch instruction.

FIGS. 6C, 6D and 6E describe an alternative technique to the techniquedescribed with reference to FIGS. 3A to 3D. In this alternativetechnique a two-state CPSR table is maintained. According to thisalternative embodiment, the current CPSR is handled differently to theother CPSRs in the table. Recall that in FIG. 2, there are six differentCPSRs each having an associated set of four condition flag states(giving a total of 24 different table entries). In the alternativeembodiment of FIGS. 6C-E, the current CPSR is handled such that we needonly have two states per flag for the current CPSR. However, these twostates mean different things. FIGS. 6C and 6D show how the two stateCPSR table (just one bit per flag for the current CPSR) and thein-flight bits (one bit per flag of every CPSR) correspond to the threestates of the state diagram of FIG. 4. FIG. 6E is an example of a use ofthe in-flight bits.

If the CPU 100 is not able to present partial CPSR results but can onlypresent full CPSR results then it is not necessary to store state foreach flag in the CPSR table. Instead, a single bit can be stored foreach of the CPSRs indicating if any CPSR is “to be traced” i.e. that theresult is “in flight” in the CPU pipeline 120.

In the FIG. 6C-E embodiment (unlike the FIG. 2 embodiment of the CPSRtable) each CPSR tag has a single bit (denoted “in flight” bits), whichindicate if a future “c-result” is expected. The CPSR table for thecurrent CPSR with two states for each CPSR flag together with the “inflight” values correspond to the three states of the state diagram ofFIG. 4. The table of FIG. 6C explains how these in-flight bits are usedand maintained. In response to a c-atom being output by the ETMinstruction key translation circuitry 186, an in-flight bitcorresponding to the conditional instruction tag (denoted “RH tag” inFIG. 6C) is set. If a conditional result is received by the second tracegeneration circuitry 192 from the ETM result key translation circuitry188, if the in-flight bit corresponding to the conditional result tag(denoted “LH tag” in FIG. 6C) is set, then the c-result is output in thetrace data stream via the FIFO 194 and the bit is then cleared. Thein-flight bits are used to determine when a previous c-result has beenreceived for a previous c-atom with the same tag (i.e. corresponding tothe same CPSR). When a c-atom is generated corresponding to aninstruction, the in-flight bit is looked up using the associatedconditional instruction trace data item tag (output by CPU 100) as anindex.

The table of FIG. 6D shows how trace keys are generated by the ETMinstruction key translation circuitry 186 (see FIG. 1) in thisembodiment. In particular if the in-flight bit value corresponds to avalue of “0” meaning that the result is not in flight, then the nexttrace key value is used. If on the other hand the in-flight bit valuehas a value of “1” indicating that the conditional result is in flight,then the same trace key value is used as was used for the most recentc-atom.

Thus the three states of the state diagram of FIG. 4 are tracked via twodata stores:

(1) The in-flight table of FIG. 6D with one bit (two states) for everyflag of every CPSR. These indicate if flags need to be traced whenemitted by the data processing apparatus i.e. which bits of the resultsare needed to reconstruct the result of the corresponding earlierconditional instruction.

(2) The CPSR table for the current CPSR which has two states (marks) foreach flag of one CPSR (the current CPSR) indicating if the conditionalinstruction is traced as a c-atom or not.

The table of FIG. 6E revisits the example of FIG. 3A and shows how thein-flight tags are set when the rules of FIG. 6C and FIG. 6D areimplemented. In the example of FIG. 6E, the conditional resultcorresponding to the three conditional instructions ADDEQ, ADDNE andADDVS becomes available after the instruction ADDVS has been decoded(similarly to the case of FIG. 3C). When the first c-atom is output inthe trace (FIG. 6E table) corresponding to the same row as the row inwhich the instruction ADDEQ is decoded, then the in-flight bit for tag Ais looked up and it is found that the result is “0” (not in flight), soa new group is started with a new trace key value. In this case c-atomskey=“0”.

When the next c-atom is generated at the same stage as the instructionADDVS being in decode, then the in-flight bit for conditionalinstruction tag A is again looked up, because the instructions ADDEQ andADDVS share the same conditional instruction tag. In this case, theresult is a “1” (indicating in-flight) so a new group is not started andthe same trace key value is used as for the most recent c-atom. Thus thec-atoms key for the instruction of ADDVS is also “0”. When theconditional result tag A is output at the stage after the decoding ofADDVS, then the in-flight bit for tag A is cleared. This bit clearanceindicated that the results corresponding to the conditional instructiontag A have been resolved so are no longer “in-flight” in the corepipeline.

FIGS. 7 to 11 schematically illustrate how conditional branchinstructions are separated from other conditional instructions in thesame trace stream and treated slightly differently. In particular,conditional branch instructions and (unconditional) load/storeinstructions are traced using so called “waypoints” whilst all otherconditional instructions are traced using the “c-atoms” as describedabove. It is known to use waypoints to trace conditional branches and toindicate which branches are taken and not taken. This is described indetail in the granted U.S. Pat. No. 7,707,394 assigned to ARM Limited.

Waypoints can be used to represent not just conditional branchinstructions, but also load/store instructions. U.S. Pat. No. 7,707,394explains how sequences of waypoints are detected and output together ina trace data stream so that the single trace data item represents aplurality of waypoints. Core tags can be associated with the waypointsin a similar way to the way in which, according to embodiments of thepresent invention, tags are associated with c-atoms (conditionalinstruction observed indicators) by the CPU 100 described above. Thesecore tags are renamed by the ETM to form trace keys that follow apredetermined order. Due to the fact that the trace keys follow apredetermined order, there is no strict requirement to output the keystogether with the waypoints.

In fact, the waypoints output in the trace data stream are labelled byone of two values, as indicated in the table of FIG. 7A. As shown inthis table, “E” labels a waypoint that corresponds to either: (a) aconditional branch instruction for which the branch was actually takenwhen the program instructions were observed; or (b) a load/storeinstruction. For these “E” waypoints a trace key is incremented by one.However, for conditional branch instructions that are not actually takenwhen the program is observed, the trace key is incremented by one andthese waypoints are labelled by “N”. In the above description of FIGS. 1to 6, the output of c-atoms is described with reference to allconditional instructions. However, in some embodiments, rather thanoutputting a c-atom for all conditional instructions, conditional branchinstructions are singled out and treated differently. In particular,instead of outputting a c-atom flagging execution of the conditionalbranch instruction, instead a waypoint is output in the trace datastream with an associated “E” or “N” status as indicated in the table ofFIG. 7A.

As described above, a plurality of waypoints can be compressed (orconcatenated) to form a single trace data output item and a plurality ofc-atoms can be compressed in a similar way. As described above, c-atomsare also subject to sequence detection and tag-to-key translation in theETM 180.

However, it should be noted that c-atoms differ from waypoints in animportant way. In particular, sequences of waypoint, keys alwaysincrement by one, but for c-atoms although C-atom keys sometimesincrement, other times they do not increment at all. In particular, whenone or more CPSR flag states of the particular tagged CPSR (A, B, C, D,E or F of FIG. 2) are “to be traced”, then the same trace key value asfor the most recent c-atom in the sequence is used and in this case thec-atom key does not increment by one. This can be encoded using twodifferent types of c-atom as illustrated in the table of FIG. 7B.

The FIG. 7B table shows that conditional instructions (with theexception of conditional branches) are characterised as follows:—conditional instructions (except for conditional branches) where thetrace key (c-result key) does not change between the previous c-atom anda subsequent c-atom are denoted “P0”; and conditional instructions(except for conditional branches) where the trace key (c-result key) isincremented by one are denoted “P1”.

Thus, for example, if we denote the c-result keys of a sequence ofc-atoms as: 0, 1, 2, 2, 3, 4, 5, 5, 6

This can be encoded as follows: P1, P1, P1, P0, P1, P1, P1, P0, P1.

It should be clear that, at the points in the sequence where the c-atomskey does not increment (i.e. where there are two consecutive “2”s andtwo consecutive “5”s), a P0 is output upon the second repetition of thesame trace key and otherwise a P1 is output. These P1 and P0 traceelements can be compressed (or concatenated) in a similar way to Eelements and N elements for waypoints. The compression for E and Nwaypoints is previously know and is described in detail in U.S. Pat. No.7,707,394. The fact that, according to embodiments of the presentinvention, c-atoms, c-results for conditional instructions and waypointscan be output by the tracing circuitry in different processing cyclesmeans that c-atoms can be output independently and subsequentlycorrelated with the corresponding c-results using a key system. Thisenables c-atoms to be compressed independently from c-results andwaypoints yet output together in the same trace data stream. Thisprovides improved efficiency by enabling independent compression ofwaypoints, c-atoms and c-results.

The table of FIG. 7C shows waypoint events and c-atoms generated by thetracing circuitry of the ETM 180 according to execution events in theCPU 100 with successive lines in the table representing successive andsequential processing cycles. The right-most column of the table of FIG.7C shows corresponding trace data output. The order of generation of thetrace data output items is indicated by the successive rows of thetable. The first trace output corresponds to compressed waypoint traceoutput “EEEN”. Notably, this is output subsequent to generation of a P1c-atom between the last of the three Es and the N. The next trace dataoutput corresponds to compressed c-atoms “P111” and again these areoutput as three consecutive c-atoms despite the three occurrences of P1being interspersed in the output sequence two N waypoints. The thirdtrace output corresponds to “P110”, which correlate with the successiveP1, P1 and P0 output in the “c-atoms generated” column. Prior to outputof these three c-atoms P1, P1, P0, two “N” waypoints have been output,but these waypoints not yet been indicated in the trace output. A finaltrace output corresponds to “NNNE”, which reflects the remainingwaypoints output prior to the P1, P1 and P0 and also the final waypointE generated at the end of the sequence.

As shown in FIG. 1, the diagnostic circuitry receives the trace dataoutput and separates the compressed c-atoms into the c-atom FIFO 197 andtraces the compressed waypoints into the waypoint FIFO 198. As a resultof the changes to the ordering as a result of the compression of thetrace output shown in the table of FIG. 7C, the diagnostic tool 196 ofFIG. 1 effectively obtains an ordering different to the execution orderwhen it decodes the trace output from the ETM 180. In this particularexample of FIG. 7C the trace output ordering is:

E, E, E, N, P1, P1, P1, P1, P1, P1, P0, N, N, N, E. The diagnosticcircuitry 196 makes use of the program image 199 to reorder thesecompressed waypoints and compressed c-atoms to restore them to a correctexecution order. The diagnostic tool 196 does this by working throughthe program image to identify all of the branches. Each branch isassociated with an E or N waypoint, which inherently gives “branchtaken” or “branch not taken” information that allows the diagnostic tool196 to determine exactly which instructions in the program image weretaken and which conditional branch instructions were not taken accordingto the conditions prevailing in the CPU 100 at the time. As thediagnostic circuitry 196 follows this thread corresponding to thewaypoints, on trawling through the program it will also encounterconditional non-branch instructions by reference to the program image199 and each of these conditional non-branch instructions is associatedin order with a c-atom in the received trace data stream. However, notethat although many conditional instructions result in generation of ac-atom there is a subset of conditional instructions that do not resultin the generation of a c-atom, for example, the ADDNE of FIG. 3B.

The table of FIG. 7D explains how the diagnostic circuitry 196 treatswaypoints and c-atoms upon receipt from the ETM 180 and places them intothe separate c-atom and waypoint FIFOs 197 and 198. The table explainsfor each instruction type encountered, when following the thread ofexecution via the program image 199, the action taken by the diagnosticcircuitry when it encounters a particular type of instruction. Onencountering a branch instruction an E or N is taken from the waypointFIFO 198. On encountering a load/store instruction again either an E oran N is taken from the waypoint FIFO 198. When a conditional branchinstruction is encountered no corresponding c-atom will be generatedbecause this is a special case dealt with by waypoints (instead ofc-atoms), so either an E or an N is taken from the waypoint FIFO 198.Conditional load/store instructions are waypoints (due to beingload/store) and can also be c-atoms (due to being conditional), but fora non-conditional load/store there is no corresponding c-atom, so inthis case an E is taken from the waypoint queue because it is known thatload/store never correspond to an N waypoint (not taken branch).However, in the case of a conditional load/store, a P0 or a P1 is alsotaken from the c-atom FIFO 197. All “other conditional instructions”(i.e. other than conditional branches and conditional load/stores) fallinto the category covered by generation of c-atoms and in this caseeither a P0 or a P1 is taken from the waypoint FIFO. Since generatedc-atoms and generated waypoints are stored in-order in the c-atom FIFO197 and the waypoint FIFO 198, so the order of removal from theseentities from the FIFOs reflect the program execution order.

FIG. 8 is a flow chart that schematically illustrates actions taken bythe diagnostic circuitry 196 upon receipt of a trace data streamcontaining both conditional atom packets and waypoint packets. Theprocess beings at stage 810 where receipt of the trace data items at thediagnostic circuitry 196 starts. Subsequently, at stage 820, thediagnostic circuitry 196 receives the next item of trace data and thenprogresses to stage 830 where it is determined whether trace item is aconditional atom (c-atom) packet. If the trace item is in a fact ac-atom packet then the process proceeds to stage 832 where the packet isdecoded and P0 and/or P1 c-atoms are added to the c-atom FIFO 197 asappropriate. The process then proceeds to stage 860 where it ends.

On the other hand, if it is determined at stage 830 that the particulartrace data item is not a c-atom packet then process proceeds to stage840, where it is determined if the trace item is a waypoint packet. Ifthe trace item is in fact a waypoint packet then the process proceeds tostage 842 where the packet is decoded and E and/or N waypoints are addedto the waypoint FIFO 198 as appropriate. Then the process proceeds tothe end stage 860. However, if at stage 840 it is determined that thetrace data item is not a waypoint packet, which means that the traceitem is neither a c-atom packet nor a waypoint packet, then the processproceeds to stage 850 where the other packet type will be handled asappropriate in a conventional manner and then the process ends at stage860.

FIGS. 9A, 9B and 9C schematically illustrate what happens to traceoutput comprising compressed waypoints and compressed c-atoms in a CPU100 capable of speculative out-of-order processing when there is abranch mispredict or when an abort occurs resulting in cancellation ofone or more waypoints.

The table of FIG. 9A schematically illustrates how a problem can occurdue to the compression of the waypoints and c-atoms in the event that atleast one waypoint is cancelled because the diagnostic tool 196 will beunaware in this situation of how many conditional instructions wereexecuted prior to the cancel event. Part way down the table of FIG. 9Athere is an event whereby one waypoint (i.e. the preceding N) iscancelled and the trace output indicates that one waypoint has beencancelled but doesn't give any information with regard to the compressedc-atoms. Note that in the trace output the first two generated c-atomsP1, P1 have not yet been output in the trace stream, but a compressedc-atom trace output “output P111” is output subsequent to thecancellation. The “output P111” means that three c-atoms P1, P1, P1 havebeen generated. Since cancellation of the waypoint N in this case (butnot necessarily) results in cancellation of the immediately subsequentc-atom P1, the diagnostic circuitry 196 will be unaware when thecompressed c-atom output P111 is received after the “cancel 1” traceoutput that one of the “P1”s corresponding to the compressed “P111”trace output was in fact cancelled. Thus, although the diagnostic toolknows which waypoint was cancelled, it does not know which of thec-atoms was also cancelled as a consequence. In other words, the orderof the c-atoms and the cancel event is lost due to compression, so thatthe diagnostic circuitry 196 does not know if the second P1 was beforethe cancel (in which case it was not architecturally executed) or afterthe cancel (in which case it was architecturally executed). Similarly ifa mispredict occurs, which requires that a conditional instruction wasnot architecturally executed, but no waypoints were cancelled in thetrace, the diagnostic circuitry 196 will not be aware that a conditionalinstruction was not executed. In order to address this and to preventthe compression of the waypoints and c-atoms resulting in the diagnosticcircuitry 196 making incorrect assumptions in the event of instructionmisprediction or cancellation, The following two rules are implemented:

-   -   I. In the event of a branch mis-predict, an abort or an        exception or any other cancel instruction a realignment trace        item is output along with the cancel trace indication (but for        an exception the sequence must be cancel, exception then        realignment);    -   II. All c-atoms already generated are output prior to the        realignment trace item;    -   III. All waypoints already generated are output prior to the        realignment trace item.

The re-alignment trace item indicates to the diagnostic circuitry 196that any c-atoms in its c-atom FIFO 197 should be discarded because theycorrespond to cancelled instructions. The table of FIG. 9B gives oneexample of use of the realignment trace data item together with thecancelled trace data item. In this example, an N waypoint is cancelledin the same way as for the example in the table of FIG. 9A, thedifference being that in this case, when the cancel indication is outputin the trace data stream an indication of all of the c-atoms alreadygenerated prior to the cancel is indicated in the trace output. Thiscorresponds to the “P11” trace output. Then the cancel indication“cancel 1” is output and then a “realignment” indication is output inthe trace. In this case the ordering of the c-atoms and the cancel ismaintained because the realignment flushes any buffered c-atoms and therealignment is always output with the cancel (either before or after).The ETM does not keep track of how many (if any) c-atoms have beencancelled because it does not store enough state to determine this.However, the diagnostic tool can work out which c-atoms have beencancelled.

FIG. 9C schematically illustrates the actions taken by the diagnosticcircuitry 196 in response to receiving the trace output indicated in thetable of FIG. 9B. The first column shows all of the trace data itemsreceived by the diagnostic circuitry 196. This is then sub divided intoa waypoint queue (second column) and a conditional queue, i.e. c-atomqueue (third column). The actions of the diagnostic circuitry 196 inresponse to receipt of the trace output is as indicated in theright-most column of the table. The first diagnostic circuitry action isto infer execution up to E. This is because instructions (other thanwaypoints and c-atoms) executed between all waypoints are inferred bythe diagnostic circuitry 196. The diagnostic circuitry 196 cannot inferup to the waypoint N because a c-atom has not yet been received and ac-atom is expected at this point by the diagnostic circuitry 196 fromits analysis of the program image 199. A “cancel 1” indication isreceived in the trace data stream after the compressed trace element P11is received, so the diagnostic circuitry cancels everything up to andincluding the last waypoint i.e. the N waypoint. Following receipt ofthe realignment trace item, the c-atom FIFO 197 is flushed removing theP11 and P1 issued prior to the cancel and the P1 added to theconditional queue at the same time that the “cancel 1” is received.Following the realignment a compressed c-atom P1110 trace is receivedbut the diagnostic circuitry is expecting from its analysis of theprogram image 199 to receive waypoints and no waypoints have beenreceived, so no c-atoms can yet be processed by the diagnosticcircuitry. The subsequent actions of the diagnostic circuitry involveinferring instructions in-between waypoints with reference to whenc-atoms are and are not required. In this way, the actual executionsequence carried out by CPU 100 is reconstructed by the diagnosticcircuitry 196. Note that load/store instructions can be conditional ornon-conditional. Non-conditional load/store instructions are treated asE atoms, so an E-atom is taken from the waypoint queue. If theload/store instruction is conditional then an E-atom is still taken fromthe waypoint queue but in addition a P0 or P1 is taken from the c-atomqueue.

FIG. 10 is a flow chart that schematically illustrates actions taken bythe diagnostic circuitry 196 to analyse incoming trace data. Inparticular, the flow chart of FIG. 10 describes how the diagnosticcircuitry removes c-atoms and waypoints from the c-atom FIFO 196 and thewaypoint FIFO 198 in performing the analysis of the execution stream.The process starts at stage 1000 and proceeds directly to stage 1010where the incoming trace data is received and the program image 199 isused to determine the next instruction executed. The process thenproceeds to stage 1012 where it is determined whether or not the nextinstruction is a non-conditional branch. If the next instruction is infact a non-conditional branch, then the process proceeds to stage 1014where either an “E” or an “N” is taken from the waypoint FIFO 198. Thenthe process proceeds to stage 1060 where the available information isused to determine the details of the current instruction andsubsequently proceeds to the end stage 1070 until the next trace dataitem is received.

If on the other hand at stage 1012 of FIG. 10 it is determined the nextinstruction is not a non-conditional branch instruction, then theprocess proceeds to stage 1020 where it is determined if the nextinstruction is a non-conditional load/store instruction (unconditional).If the instruction is in fact a non-conditional load/store instructionthen the process proceeds, to stage 1014 where an E or an N is takenfrom the waypoint FIFO 198 and then the process proceeds to stage 1060and subsequently end stage 1070. If at stage 1020 it is determined thatthe next instruction is not a non-conditional load/store instruction,then the process proceeds to stage 1030 where it is determined whetheror not the instruction is a conditional branch. If the instruction is infact a conditional branch then the process proceeds to stage 1014 and anE or an N is taken from the waypoint FIFO 198 and then the processproceeds to stage 1060 and 1070 where the process ends. If, on the otherhand, at stage 1030 it is determined that the next instruction is not aconditional branch then the process proceeds to stage 1040 where it isdetermined whether or not the next instruction is a conditionalload/store. If the next instruction is in fact a conditional load/storethen the process proceeds to stage 1042 where an E or N is taken fromthe waypoint FIFO 198 and then the process proceeds to stage 1044 whereeither a P0 or a P1 is taken from the c-atom FIFO 197. Thus forconditional load/store instructions an item is taken from each of thewaypoint queue and the c-atom queue. Then the process proceeds to stage1060 and 1070.

If at stage 1040 the instruction is found not to be a conditionalload/store then the process proceeds to stage 1050 where it isdetermined whether or not the instruction is a conditional instruction.If the instruction is a conditional instruction then a P0 or P1 is takenfrom the c-atom queue 197 and then the process proceeds to stage 1060where details of the current instruction are determined and then ends atstage 1070. However, if the next instruction is not a conditionalinstruction then process proceeds from stage 1050 directly to stage 1060where the available information is used to determine the details of thecurrent instruction. But in this case, the current instruction is noneof a non-conditional branch instruction, a non-conditional load/storeinstruction, a conditional branch instruction, a conditional load/storeinstruction or a conditional instruction.

FIGS. 11A, 11B and 11C are examples of relative orderings of output in atrace data stream of a cancel trace indication, a mispredict traceindication, an exception trace indication and a realignment traceindication.

In the case of the example of FIG. 11A, the first waypoint E correspondsto a branch mispredict and a realignment trace item is placed after themispredict but before the next waypoint or c-atom.

In the case of FIG. 11B the second waypoint i.e. the second “E”corresponds to a branch that mispredicts. A realignment trace item isplaced after the mispredict but before the next waypoint or c-atom (inthis particular example, before the next waypoint E).

In the example of FIG. 11C an abort occurs between the first and secondwaypoints “E” and “E” (first and third trace items in the sequence). Inthis case an exception is thrown and the realignment trace item isplaced after the exception but before the next waypoint or c-atom. Notethat in this case the c-atom P1 (second trace item in sequence) isgenerated between the two waypoints E and E between which the abortoccurs, but the realignment item should still be placed after theexception.

FIGS. 12 to 14 schematically illustrate how a trace data streamcomprising c-atoms can be compressed by removing conditional atoms thatcan be implied by the conditional results. Removal of subset of c-atomsfrom the trace data stream in this way can be used to improve efficiencyof the tracing process. Although not all conditional instructions resultin generation of c-atoms, there is often a one-to-one correspondencebetween c-atoms and c-results and every c-result must have at least onecorresponding c-atom. This means that in many cases the diagnosticcircuitry 196 can imply the presence of c-atoms when a subsequentc-result is encountered without the c-atoms actually having to beincluded in the trace data stream. Thus if the diagnostic circuitry 196receives a c-result with a c-result key corresponding to a c-atom (i.e.c-atom key) that has not been received by the diagnostic circuitry thenthe diagnostic circuitry 196 can deduce the existence of that c-atom. Ifthe c-results are out of order, then the diagnostic circuitry 196 candeduce the existence of other c-atoms in order to keep c-atoms in order.C-atoms can be deduced by the diagnostic circuitry 196 later than whenthey would otherwise appear and hence c-atoms and waypoints may changeorder. However, this does not matter because, as previously discussed,the c-atoms and waypoints stored in the c-atom FIFO 197 and the waypointFIFO 198 can in any case be placed in the correct order by thediagnostic circuitry 196 with reference to the program instructionsequence in the program image 199.

FIG. 12A schematically illustrates a table comprising an example of atrace data stream in which a series of c-atoms (i.e. trace data itemscorresponding to execution of the instructions) are implied based on theoutput of c-results keys output by the results key translation circuitry188 of FIG. 1. In this example, a sequence of five P1 c-atoms aregenerated but not output by the ETM 180. Similarly the c-atoms keysdenoted in the table by “RH key” are also generated by the ETM but arenot output. This can be viewed as buffering of the c-atoms. When ac-result is output an imply bit represents those buffered c-atoms.However, the corresponding conditional result keys are in fact output bythe results key translation circuitry 188. It will be clear from thetrace which c-atoms are associated with the c-result although key valuesare not given explicitly. Although the full c-atom information is notoutput the c-results packet effectively contains information with regardto c-results. The c-atoms are highly compressed (down to 1 bit). Thefourth column of the table of FIG. 12A schematically illustrates whichc-atom keys are implied by the diagnostic circuitry 196 based upon thereceived c-result keys. In this case the correspondence is astraightforward one in which the c-results 0, 1 and 2 are implieddirectly corresponding to the c-result keys. However, the c-result key 4is output before the c-result key 3, so when the diagnostic circuitry196 receives the c-result key 4, it implies that the c-atom key 3 hasalso been generated although the corresponding result has not yet beoutput. Indeed, from the “c-result LH key output” column of the FIG. 12Atable, it can be seen that the c-result key 3 is generated immediatelyafter the c-result key 4. Thus to imply the c-atom keys 3 and 4 togetherwas in fact correct. Notably, in the example of the table if FIG. 12A,the generated c-atoms comprise only P1 atoms and not P0 atoms. Recallthat for P1 c-atoms the trace key is always incremented by one whereasfor P0 atoms the trace key does not change. It follows that whilst P1c-atoms can be implied by the presence of c-results, the same is nottrue of P0 atoms. In fact P0 c-atoms cannot be deduced by the presenceof c-results so all P0 c-atoms need to be output in the trace and cannotbe buffered.

There are another two special situations where it is inappropriate torely upon buffering of output of c-atoms by the ETM 180 and implicationof the corresponding c-atoms from the c-results by the diagnosticcircuitry 196. The first of these two situations is in the case of arealignment trace item where all c-atoms known before the realignmentmust be output by the ETM 180 despite the fact that subsequent c-resultscould in principle be used to imply them. This is to ensure the correctrelative ordering of waypoints and c-atoms by the diagnostic circuitry196 is deduced.

A further situation where it is inappropriate to buffer output ofc-atoms and to imply the existence of c-atoms from received c-resultkeys is where the c-atoms themselves have been allocated a c-atom key bythe instruction key translation circuitry 186 that it is not strictlysequential, for example the use of special keys.

There are also certain cases where a c-result output by the ETM 180 andreceived by the diagnostic circuitry 196 must not be used to implyfurther c-atoms. The following three situations are examples of suchcases, where the diagnostic circuitry cannot differentiate between:

1. The same c-result key being used twice;

2. N c-atoms are buffered where N=number of sequential trace keys.

In fact the c-result output by the ETM 180 is required to containinformation that informs the diagnostic circuitry 196 whether or notc-atoms should be implied from the corresponding c-result. In theembodiment of FIG. 1, this information with regard to whether or notc-atoms should be implied for a given c-result is a straightforwardyes/no condition and the precise number of c-atoms to imply is notspecified explicitly to the diagnostic circuitry 196.

FIG. 12B is a table that schematically illustrates an example of a tracedata stream in which some c-atom keys are implied from correspondingc-results and in which four different c-atom trace keys are employed.Because only four c-atom trace keys can be used after all of the keyshave been exhausted then there is a wraparound of the keys. Inparticular, it can seen that the c-atom key sequence progresses as 0, 1,2, 3 and then returns back to 0 corresponding to the fifth P1 c-atomgenerated but not output. Furthermore, in the example of FIG. 12B thefifth, sixth and seventh P1 c-atoms that are generated but not outputcorrespond to a mispredict so these three c-atoms are not actuallyexecuted and hence the corresponding c-results and c-result key arenever output.

C-results contain at least three pieces of information:

1. The key associated with the conditional result either explicitly orrelative to the most c-result;

2. A payload that allows the diagnostic circuitry 196 to determine apass/fail status of the conditional instruction (i.e. to determinewhether or not the conditional instruction was actually executed); and

3. Whether or not a corresponding c-atom can be implied based on thatc-result and this is a straightforward two bit indicator i.e. imply yesor imply no.

In order to apply the imply-yes or imply-no information, the ETM 180 isconfigured to keep track of the c-atoms that were generated by theinstruction key translation circuitry 186 but whose output to thediagnostic circuitry 196 was buffered. The ETM 180 determines what eachc-result is and which, if any, of the c-atoms can be implied by thec-result. If no c-atoms are implied by the c-results then the c-resultis marked as imply-no, otherwise it is marked as imply-yes by the ETM180. This is achieved using two registers.

A “last-c-atom-generated-key” register comprises the key of the mostrecently generated but not output c-atom. An exception to this is wherethe most recently generated but not output c-atom had a special key. Aseparate “last-c-atom-output-key” register records the trace key of themost recent of either: (i) an explicitly output c-atom; or (ii) c-atomimplied by the c-result.

When a c-result is generated the corresponding c-result key is tested tosee if it is in the range (last c-atom-output-key)<(c-result LHkey)<=(last-c-atom-generated-key). When applying this test modulus mathsmust be used and the handling of modulus maths is well known to thoseskilled in the art. If the c-result key is in fact in this defined rangethen an imply-yes is output as part of the c-result by the ETM 180.

FIG. 13 is a table that schematically illustrates a trace data sequencesimilar to the sequence of FIG. 12B, but in which the values stored inthe “last-c-atom-generated-key” register and the“last-c-atom-output-key” register are shown in the second and thirdcolumns from right respectively. The right-hand column of the table ofFIG. 13 gives an indication of whether the test (i.e. the imply-yes)defined by the above equation has been met or not. Note that due to theuse of only four trace keys and due to the wraparound of the keys, a keyof “3” can be considered to be less than a key of “0” because of therepeating key sequence of 0, 1, 2, 3, 0, 1, 2, 3, . . . where forexample the first “3” is before the second “0”. The implied c-atom keymarked 3* in the “implied c-atom RH keys” column of the FIG. 13 table,is implied shortly after the output of realignment item and in this casethe c-atoms with keys of 0, 1, 2 are not implied because they have beenexplicitly output due to the preceding mispredict, where the three P1c-atoms corresponding to c-atom keys 0, 1 and 2 were not executed.

For the c-result key of “2” that is output in the second from last rowof FIG. 13, the c-atom with key 2 corresponding to the c-results key 2is not implied because it has already been implied by an earlierc-result and hence the test whose outcome is specified in the right-handcolumn of FIG. 13 is not met. For the c-result key output in the lastrow of the table of FIG. 13 a corresponding c-atoms with a key 1 is notimplied because it has already been explicitly output the columnentitled “explicitly output c-atoms keys”. FIG. 13 shows that c-atomkeys 0, 1, 2 are explicitly output as a result of the mis-prediction andc-atom keys 0 and 1 are explicitly output due to the occurrence in thetrace data stream of the P0 c-atom (third form last generated c-atom inleft-most column of table) for which the implication of c-atoms fromcorresponding c-results is not permitted.

C-atoms are explicitly output for the following reasons:

-   -   Before a realignment trace item is output (e.g. due to a        mis-predict or exception)    -   If a P0 c-atom type is used (where the trace key does not        increment by definition)    -   if special key is used which does not follow the normal        sequential ordering of the keys and is used for very late        c-results.

When c-atoms are explicitly output, the “last-c-atom-output-key”register can be used to determine which c-atoms should be output. Forinstance, in the case of realignment trace item, the first c-atom to beexplicitly output is a value of the “last-c-atom-output-key plus one”register and the last to be output is the value of thelast-c-atom-generated-key. C-atoms with keys in between should also beoutput.

FIG. 14 a is a flow chart that schematically illustrates actions of theETM 180 in outputting the trace stream and implementing a tracecompression scheme where certain c-atoms are generated but not output(i.e. buffered) relying upon the ability of the diagnostic circuitry 196to imply c-atoms from corresponding c-results. In other words, the flowchart of FIG. 14 a schematically illustrates how the ETM 180 acts tocompress the output trace data stream via removal of a subset of c-atomsfrom the trace data stream.

The process starts at stage 2000 and then progresses to stage 2001,where it is determined whether or not a realignment trace data item isrequired. If a realignment trace item is required then the processproceeds to stage 2110 where the ETM 180 explicitly outputs all c-atomsgenerated but not output. The process then proceeds to stage 2120 wherethe last-c-atom-output-key is updated and then to stage 2130 where therealignment trace data item is actually output into the trace datastream and the process then returns to the vertical flow and progressesto stage 2200. If on the other hand at stage 2100 it is determined thata realignment trace data item is not required, then the process proceedsdirectly to stage 2200 without proceeding along the horizontal branchcompressing stages 2110, 2120 and 2130.

At stage 2200 it is determined whether or not a c-result is currentlybeing generated. If no c-result is being generated then the processproceeds directly to stage 2300. On the other hand, if it is determinedat stage 2200 that a c-result is in fact currently being generated thenthe process proceeds to stage 2210 where it is determined if the c-atomcorresponding to the current c-result is currently being buffered. Oneexample of such a test is to determine if the key corresponding to thec-result being generated satisfies the test: (lastc-atom-output-key)<(c-result LH key)<=(last-c-atom-generated-key). Inother words, if a key corresponding to the conditional instruction tracedata item currently being generated is greater than a key correspondingto said most recently output conditional instruction trace data item andis less than or equal to a key corresponding to said most recentlygenerated conditional instruction trace data item. Since values of thekeys wrap around when a maximum value is reached for the test to workproperly, the key comparison observes modulo arithmetic.

If it is determined at stage 2210 that the c-atom corresponding to thec-result is not currently being buffered then the process proceeds tostage 2230 where the c-result just generated is output with the impliedbit being cleared indicating that no c-atoms should be implied by thediagnostic circuitry 196 based on this particular c-result. If on theother hand it is found at stage 2210 that the c-atom corresponding tothe current c-result is currently being buffered, then the processproceeds to stage 2222 where the c-result is output with the implied bitset indicating that the diagnostic circuitry 196 should imply acorresponding c-atom from the c-result. After outputting the c-resultwith the implied bit set the process proceeds to stage 2224 where thevalue of the last-c-atom-output-key is updated in the appropriateregister and then the process proceeds to stage 2300.

At stage 2300 it is determined whether or not a c-atom is beinggenerated. If a c-atom is not being generated then the process ends atstage 2400. If on the other hand, a c-atom is being generated then theprocess proceeds to stage 2310 where it is determined if the c-atom isof type P0 rather than P1 or if it corresponds to a special key. If thec-atom is not one of these exception types then the process proceeds tostage 2320 and the last-c-atom-generated key is updated and then theprocess ends at stage 2400. However, if the c-atom does correspond to aspecial key or is of type P0, then process proceeds to stage 2312 wherethe c-atom being generated is caused to be output explicitly along withall other c-atoms that have been generated but not yet output. Then theprocess proceeds to stage 2314 where the last-c-atom-output key isupdated. The process then proceeds to stage 2320 where thelast-c-atom-generated key is updated and then ends at stage 2400.

FIG. 14 b illustrates a trace unit 180 according to an embodiment of thepresent invention. It is similar to the trace unit shown in FIG. 1 andthe same reference numerals are used where appropriate. It has anadditional condition code or CPSR value storage buffer 185 and a tokenbuffer 187 with associated compress and combine circuitry.

The data sent from the results interface 184 comprises the CPSR valuesfrom each updated CPSR register along with additional data. As there arein this embodiment 8 CPSR registers on CPU 100, there are 8 possiblesets us that can be received in a single cycle. Rather than inputtingthese all to trace generation circuitry 192 in a single cycle whichwould require the trace generation circuitry 192 to process these whichwould be costly, these are buffered in CPSR value storage buffer 185.Thus, they can be steadily output over time. In this embodiment in eachclock cycle two sets of CPSR values are output. These may be randomlyselected or a particular set of CPSR values may need to be output if anupdated set of CPSR values for that CPSR is to be received at the input.This is to ensure the correct ordering of conditional atom trace dataitems and conditional results trace data items in the trace stream.

In this regard the receipt at the instruction interface 182 of theconditional instruction observed indicators from decode of theprocessing apparatus with associated “tags” identifying the particularCPSR register to be updated by an instruction provides an advanceindication of which CPSR registers are to be updated. In the case thatCPSR values for which valid values are currently stored in buffer 185are to be received these valid values are selected for output so thatthe storage location is free to store the new data that willsubsequently be received.

When they are output they are processed by the trace generationcircuitry 192 which generates trace data items. As in this embodimenttwo conditional instruction observed indicators can be received in anyone cycle, at most two sets of CPSR values may need to be evicted andthus, the output of two sets of CPSR values per cycle is sufficient tomaintain the correct values stored in the buffer 185 and means that thetrace generation circuitry 195 needs only to have sufficient processingpower to process two sets of values per cycle.

In this embodiment there is additional circuitry 187 for receiving tracedata items generated by trace generation circuitry 192, this circuitrycompresses common trace data items to form tokens which are compressedrepresentations of these trace data items and these are stored in thetoken buffer. They can then later be combined together and several canbe output as a single trace item. Typically the smallest trace packet is8 bits long and packets are often multiples of 8 bits, while tokens aretypically much smaller, so they several can be combined into one packetfor output.

Examples of common conditional results trace data items that can berepresented by tokens are:

Those containing one of the more common CPSR values. Some CPSR valuesare significantly more common than others. For instance the followingvalue is very common N-clear, Z-clear, C-set, V-clear.

Those where the key contained in the conditional results trace data itemis one more than the previous such key.

It is convenient if these are stored in the buffer for as long aspossible to provide more opportunities for combining different tokensinto single packets. However, the buffer only has a limited size andthus, they must be output either when the buffer becomes full or when anitem is received for which there is no token available (perhaps it is anuncommon item that it is not efficient to compress). In the latter casein order to maintain the order, the buffer is cleared by outputting allthe values and then the received non-compressed item is output.

Typically these tokens are held in the buffer for as long as possible asthen the possibilities for combining different tokens within a singletrace item are greater.

The description of FIGS. 15 to 27 are part of co-pending GB patentapplication 1100505.5 entitled “Processing Apparatus, Trace Unit andDiagnostic Apparatus” with inventors John Michael Horley, Simon JohnCraske, Michael John Gibbs and Paul Anthony Gilkerson from whichpriority is claimed. FIGS. 15-27 below are thus provided forillustrative purposes and for further explaining the buffering ofconditional result trace data items (c-atoms) and the fact that not allconditional instructions have corresponding c-atoms. They also help toillustrate how CPSR marked bits are used as described in FIGS. 3A to 3D.FIGS. 22 and 25 are particularly relevant in this regard.

FIG. 15 illustrates a processing apparatus 3002 comprising a processingcircuit 4 for performing processing operations in response to programinstructions. The processing apparatus 3002 is provided with a memorysystem 3008 which comprises one or more cache units or memory units forstoring program instructions to be executed by the processing circuit3004 and/or data to be processed by the processing circuit 3004.

The processing apparatus 3002 includes a trace circuit 3006 formonitoring the processing operations performed by the processing circuit3004. The trace circuit 3006 generates trace data elements indicatingcharacteristics of the processing operations performed by the processingcircuit 3004. The trace circuit 3006 outputs the generated trace dataelements over an output port 3010. The trace circuit 3006 need not beimplemented on the same integrated circuit as processing circuit 3004and in some embodiments may be provided as a separate trace unit.

A diagnostic apparatus 3012 is provided for analysing the trace dataelements generated by the trace circuit 3006. The diagnostic apparatus3012 receives the trace data elements over an input port 3014. Thediagnostic apparatus 3012 also receives an indication of which programinstructions were executed by the processing circuit 3004. Thisindication may be provided by the trace circuit 3006 indicating in thetrace stream which instructions were executed. Alternatively, thediagnostic apparatus 3012 may be provided with an address indicating thelocation within the memory system 3008 of the first program instructionthat was executed by the processing circuit 3004. The diagnosticapparatus 3012 may also be provided with a memory (not illustrated inFIG. 15) for storing a corresponding copy of the program that wasexecuted by the processing circuit 4. The diagnostic apparatus 3012analyses step-by-step the instructions that were executed by theprocessing circuit 3004, and determines processing outcomes of theinstructions based on the information included in the stream of tracedata elements.

The trace data elements need not be output directly from the tracecircuit 3006 to the diagnostic apparatus 3012 but may be, for example,stored in a memory or other storage device and then accessed from thestorage device by the diagnostic apparatus 3012 when desired. Thediagnostic apparatus 3012 may be, for example, a general purposecomputer programmed to execute a trace analysis method.

The processing apparatus 3002 has a storage location, for example acondition status register (CPSR) 3020, for storing one or more conditionflags 3022 indicating respective conditions of the processing apparatus3002. In the processors designed by ARM Limited of Cambridge, UK, thecondition flags 3022 may include NZCV (Negative, Zero, Carry, oVerflow)flags for indicating whether a processing result is negative, zero,required a carry, or caused an overflow. FIG. 17 illustrates variouscondition states which can be indicated by different combinations of thecondition flags 3022 in the condition status register 3020.

It will be appreciated that the storage location for storing thecondition flags 3022 need not be a condition status register 3020 butmay also be a storage location within the memory system 3008, or anyother kind of storage location.

The processing circuit 3004 may be responsive to at least one conditionupdating instruction to update one or more of the condition flags 3022in the condition status register 3020. For example, a compareinstruction may compare two data values and update the flags independence on the comparison, for example to indicate whether the valueswere equal or whether one value was less than or greater than the othervalue. Any instruction which causes the condition flags 3022 to beupdated may be considered to be a condition updating instruction. Forexample, in the ARM instruction set architecture, the TST, TEQ, CMP andCMN instructions are examples of condition updating instructions.

The processing circuit 4 may also be responsive to at least oneconditional instruction which is associated with a given condition. Whena conditional instruction is executed, then the values of the conditionflags 3022 are compared with the given condition. If the condition flags3022 satisfy the condition, then an associated processing operation isperformed. If the condition is not satisfied, then the associatedprocessing operation is not performed (alternatively, for some kinds ofconditional instruction a different processing operation to theassociated processing operation may be performed if the condition is notsatisfied).

For example, a conditional add instruction ADDEQ is associated with theEQ condition. FIG. 16 indicates that the EQ condition is satisfied ifthe Z flag is set. When the conditional add instruction ADDEQ isexecuted, then if the Z flag is set then the associated add operationwill be performed, while if the Z flag is not set then the add operationwill not be performed.

The processing outcome of the conditional instruction cannot bedetermined from the instruction stream alone, since the instructionstream contains no information for determining whether the condition wassatisfied. Therefore, the trace circuit 3006 is responsive to at leastone selected instruction to generate a trace data element including atraced condition value indicative of the values of the condition flags3022. The diagnostic apparatus 3012 can use the traced condition valueincluded in the trace data element to determine whether the conditionwas satisfied, and therefore can determine the processing outcome of thecorresponding conditional instruction.

The trace circuit 3006 maintains one or more control flags 3026 formonitoring whether or not the values of the condition flags 3022 havebeen traced. The trace circuit 3006 may select whether or not to tracethe condition flag values on execution of a given instruction based onthe current values of the one or more control flags 3026. In oneembodiment, the trace circuit 6 includes a single control flag 3026 (seethe embodiment of FIGS. 22-24 as described below), while in anotherembodiment the trace circuit 3006 includes multiple control flags 3026each corresponding to one of the condition flags 3022 (see theembodiment described below with respect to FIGS. 25-27).

The diagnostic circuit 3016 maintains a corresponding set of controlflags 3028, which are used in a corresponding way to the control flags3026 of the trace circuit 3006 to determine whether or not a trace dataelement including a traced condition value is expected to be provided inthe trace stream for a given program instruction.

The traced condition value within the trace data elements may beindicated in different ways. In one example, the trace circuit 3006 mayinclude the actual values of at least a subset of the condition flags3022 in the trace data element. Where a conditional instruction isdependent on only a subset of the condition flags 3022, then the tracecircuit 3006 may include just the relevant subset of condition flagvalues, or may include all of the condition flags 3022.

Alternatively, the trace circuit 3006 may include in the trace dataelement an identifying code indicating a particular combination ofvalues of the condition flags 3022. This may provide an efficientencoding if some combinations of condition values are more common thanothers. For example, FIG. 17 shows an example in which a 2-bitidentifier is used for three of the condition states (for example thestate in which the C flag is set, the state in which the N flag is set,and the state in which the Z and C flags are set). A 4-bit identifier isthen used for three more of the different condition states. If one ofthe other combinations of condition flag values is required then aseparate indication of the current condition flag values may be providedin the trace data element, using a different encoding to the schemeshown in FIG. 17.

It will be appreciated that the encoding of the identifiers, and theselection of which condition states are represented by a particularidentifier, is only an example. Nevertheless, this example demonstratesthat the total amount of trace data can be reduced by allocating theidentifiers having the fewest bits to the condition states which arisemost frequently. For example, if the processing apparatus 3002 is in oneof the three condition states having a 2-bit identifier for 70% of thetime, in one of the three states having a 4-bit identifier for 29% ofthe time, and in one of the other states for 1% of the time (and thoseother states are represented by an 8-bit identifier, say), then theaverage number of bits used to identify the current condition statewould be 2*0.7+4*0.29+8*0.01=2.64 (the asterisk * indicates a multiplysign). Hence, the average number of bits included in the trace stream toindicate the current condition state would be less than the 4 bits thatwould be used if the trace data element simply included the currentvalues of the condition flags.

The trace circuit 6 may trace the values of the condition flags 3022 atdifferent instructions of the program being executed by the processingcircuit 4. The trace circuit 3006 may select one or more selectedinstructions for triggering generation of a trace data element includingcondition flag indicating values. The selected instruction may be aconditional instruction, but may also be another instruction.

For example, FIGS. 18-20 show an example in which a trace data elementincluding a traced conditional value is generated upon execution of acondition updating instruction. FIG. 18 shows a method of generatingtrace data in response to operations of the processing circuit 3004. Atstep 3040, the processing circuit 3004 processes a next instruction ofthe program being executed, and the trace circuit 3006 monitors theprocessing of that instruction by the processing circuit 3004. At step3042, the trace circuit 3006 determines whether or not the instructionbeing executed by the processing circuit 3004 is a condition updatinginstruction. If the instruction is a condition updating instruction,then at step 3044 the trace circuit 3006 generates and outputs a tracedata element including a traced condition value indicating the updatedvalue of the condition flags 3022 resulting from execution of thecondition updating instruction. On the other hand, if the instructionwas not a condition updating instruction then step 3044 is omitted. Atstep 3046, it is determined whether or not there is another instructionto be processed by the processing circuit 3004. If there is anotherinstruction, then the method returns to step 3040, while otherwise ifthere are no instructions left then the method ends at step 3048.

FIG. 19 illustrates a corresponding diagnostic method for analysing thetrace stream produced by the trace circuit 3006 using the method of FIG.19. The diagnostic apparatus 3012 receives an indication of whichinstructions were executed by the processing circuit 3004. At step 3050,the diagnostic circuit 3016 analyses a next instruction indicated asbeing executed by the processing circuit 3004. At step 3052, thediagnostic circuit 3016 determines whether or not the next instructionis a conditional instruction. If the instruction is a conditionalinstruction, then at step 3054 the diagnostic circuit 3016 locates inthe trace data stream a trace data element associated with the mostrecent condition updating instruction that was indicated in theindication of program instructions. At step 3056 the diagnostic circuit3016 determines the processing outcome of the conditional instructionbased on the traced condition value included in the located trace dataelement. For example, the diagnostic circuit 3016 can use the tracedcondition value to determine whether or not the condition associatedwith the conditional instruction was satisfied and accordingly whetheror not the associated operation was performed or not. If at step 3052the next instruction was determined not to be a conditional instructionthen steps 3054 and 3056 are omitted. At step 3058, it is determinedwhether or not there is another instruction to be analysed. If there isanother instruction, then the method returns to step 3050, while ifthere are no more instructions then the method ends at step 3060.

FIG. 20 illustrates an example of the generation of a trace streamaccording to the method of FIG. 18 and the analysis of the trace streamaccording to the method of FIG. 19. FIG. 20 shows a set of programinstructions that were executed by the processing circuit 3004. When abranch instruction is executed then a trace data element is generatedindicating whether or not the branch was taken. When a conditionupdating instruction (e.g. CMP) is encountered, then according to step3044 of FIG. 18 a trace data element is generated including a tracedcondition value CPSR. When analysing the trace stream, then thediagnostic apparatus can use the traced condition value to determine theprocessing outcomes of any following conditional instructions (forexample, the instructions MOVNE, MOVEQ, and ADDHI shown in FIG. 20).

Some instructions may be both a condition updating instruction and aconditional instruction. For example, the program instruction at memorylocation 2100 in FIG. 20 is a conditional compare instruction CCMPNE forcontrolling the processing circuit 3004 to determine whether or not thecurrent values of the condition flags 3022 satisfy the not equal (NE)condition (see FIG. 16). If the not equal condition is satisfied, thenthe processing circuit 3004 performs a comparison operation and updatesthe condition flags 3022 based on the comparison result. As the CCMPNEinstruction is a conditional instruction, then the diagnostic circuit3016 determines the processing outcome of the CCMPNE instruction basedon the traced condition value included in the trace stream at the mostrecent update of the condition flags (i.e. the CPSR value included forthe compare instruction CMP at memory location 2000). If the NEcondition is satisfied upon execution of the CCMPNE instruction, thenthe CCMPNE instruction is also a condition updating instruction and sothe trace circuit 3006 generates a trace data element for instructionCCMPNE including a traced condition value indicating the updated valuesof the condition flags 3022. This trace data element can the be used fordetermining the outcomes of any subsequent conditional instructions.

Alternatively, in some examples the CCMPNE instruction may be consideredas a condition updating instruction regardless of whether the NEcondition was satisfied, and thus a trace data element indicating thevalues of the condition flags could always be generated for the CCMPNEinstruction. This could be useful if the NE condition has not yet beencalculated at the time of tracing.

The technique shown in FIGS. 18-20 can be useful when a single conditionupdating instruction is followed by a chain of conditional instructionsall dependent on the same set of condition values, because in this casea small amount of trace data is sufficient to determine the outcomes ofseveral following instructions.

However, in some situations there may be many condition updatinginstructions which occur in succession without any interveningconditional instructions which use the updated values of conditionflags. For example, in FIG. 21 a sequence of program instructionsincludes a number of compare CMP and bit test TST instructions whichresult in a condition flag update, but the first four of theseinstructions update the flags without those updated values ever beingused by a conditional instruction. In such a situation it can be moreefficient to generate the trace data element including the tracedcondition value upon execution of a conditional instruction (forexample, as described below with reference to FIGS. 22-24 and 25-27). Inthe example shown in FIG. 21 then the trace data element could begenerated when the conditional instruction MOVNE is executed, ratherthan on each condition update.

It will be appreciated that a mixture of these techniques may bepossible and so some trace units may generate traced condition valuesboth on execution of a condition updating instruction and on executionof a conditional instruction.

FIG. 22 shows a trace method in which the condition flags 3022 aretraced on execution of a conditional instruction. In this embodiment,the trace circuit 3006 maintains a control flag 3026 for determiningwhether or not to trace the values of the condition flags 3022. Thecontrol flag 3026 has a “clear” state and a “set” state (for example,the “clear” state may be the control flag 3026 having a 0 value and the“set” state may be the control flag 3026 having a 1 value, or viceversa).

At step 70 of FIG. 22, the trace circuit 3006 monitors the processingcircuit 3004 executing a next instruction. At step 3072, the tracecircuit 3006 determines whether or not that instruction is a conditionalinstruction. If the instruction is a conditional instruction, then atstep 3074 the trace circuit 3006 determines whether or not the controlflag is clear. If the control flag is clear, then at step 3076 the tracecircuit 3006 generates and outputs a trace data element including atraced condition value which indicates the current state of thecondition status register 3020. Then, at step 3078 the control flag isset. On the other hand, if at step 3074 the control flag was set, thensteps 3076 and 3078 are omitted. If at step 3072 the instruction wasdetermined not to be a conditional instruction, then steps 3074 to 3078are omitted.

Then, at step 3080, it is determined whether or not the next instructionis a condition updating instruction. Note that some instructions may beboth a conditional instruction and a condition updating instruction. Ifthe instruction is a condition updating instruction, then at step 3082the control flag is cleared. Otherwise, step 3082 is omitted. Then atstep 3084, it is determined whether or not there is another instructionto be processed by the processing circuit 3004. If there is anotherinstruction, then the method returns to step 3070. If there are no moreinstructions, then the method ends at step 3086.

Some pseudocode for implementing the method of FIG. 22 is indicatedbelow (the term “marker” indicates the control flag 3026):

On an instruction:

-   -   If instruction is conditional:        -   If marker is clear:            -   Trace the CPSR            -   Set marker    -   If instruction updates the CPSR:        -   Clear marker

The method of FIG. 22 helps to reduce the amount of trace data since thetrace circuit 3006 generates a trace data element including a tracedcondition value on the first conditional instruction which occursfollowing a condition updating instruction. For subsequent conditionalinstructions then there is no need to trace the condition value becausea previous conditional instruction already has an associated trace dataelement which contains information indicating the state of the conditionflags 3022.

FIG. 23 shows a corresponding diagnostic method for analysing the tracestream produced in the method of FIG. 22. The diagnostic apparatus 3012has a control flag 3028 having “clear” and “set” states corresponding tothe states of the control flag 3026 of the trace circuit 3006. At step3100, the diagnostic circuit 3016 analyses the next instruction includedin the indication of the program instructions processed by theprocessing circuit 3004. At step 3102, it is determined whether or notthere is an indication of a conditional instruction. If the instructionis a conditional instruction, then at step 3104 it is determined whetheror not the diagnostic control flag 3028 is clear. If the diagnosticcontrol flag is clear, then at step 3106 the diagnostic circuit 3016locates an associated trace data element for that conditionalinstruction and at step 3108 determines a processing outcome of theconditional instruction based on the traced condition value included inthe associated trace data element. At step 3110, the diagnostic controlflag is placed in the “set” state.

On the other hand, if at step 3104 the diagnostic control flag was notclear, then the method proceeds to step 3112 at which a further tracedata element is located by the diagnostic circuit 3016. The furthertrace data element is a data element associated with a previouslyanalysed conditional instruction. At step 3114, the diagnostic circuit3016 determines the processing outcome of the currently analysedconditional instruction based on the traced condition value included inthe further trace data element generated for the previously analysedconditional instruction. If at step 3102, the instruction was determinednot to be a conditional instruction, then steps 3104 to 3114 areomitted.

Then, at step 3116 it is determined whether or not the instruction beinganalysed is a condition updating instruction. The instruction may beboth a conditional instruction and a condition updating instruction. Ifthe instruction is a condition updating instruction then at step 3118the diagnostic control flag 3028 is cleared, while if the instruction isnot a condition updating instruction then step 3118 is omitted. At step3120, it is determined whether or not there is another instruction to beanalysed. If there is another instruction, then the method returns tostep 3100, while otherwise the method ends at step 3122.

Thus, the diagnostic circuit uses a diagnostic control flag 3028corresponding to the control flag 3026 of the trace circuit 3006 todetermine whether or not an associated trace data element is expected tobe included in the trace stream for a given conditional instruction. Ifthere is such an associated trace data element then the processingoutcome of the conditional instruction can be determined based on thetraced condition value included in the associated trace data element. Ifthere is no associated trace data element, then there will be a tracedata element associated with a previous conditional instruction thatwill contain a traced condition value enabling the processing outcome ofthe current conditional instruction to be determined. When a conditionupdating instruction is encountered, then the diagnostic control flag3028 is cleared to indicate that the next conditional instruction willbe expected to have an associated trace data element.

FIG. 24 illustrates an example of the application of the method of FIGS.22 and 9 to the stream of program instructions shown in FIG. 20. Again,the branch taken result of the branch instruction at memory location1600 is traced. In response to execution of the condition updatinginstruction CMP stored at memory location 2000, then the trace circuit3006, according to step 3082 of FIG. 22, clears its control flag 26. Ina similar way, when the diagnostic circuit 3016 analyses theinstructions then it will respond to an indication of the conditionupdating instruction CMP by clearing its diagnostic control flag 3028,according to step 3118 of FIG. 23.

When the trace circuit 3006 encounters the conditional instruction MOVNEstored at memory location 2004, then the trace circuit 3006 determinesthat the control flag 3026 is currently in the cleared state, and so atstep 3076 of FIG. 22 a trace data element is generated including atraced condition value CPSR. The control flag is then set, according tostep 3078 of FIG. 22. In a corresponding way, when analysing theinstructions, the diagnostic circuit 3016 will detect an indication ofthe conditional instruction MOVNE at memory location 2004 and will thenrespond to the diagnostic control flag 3028 being clear by locating theassociated trace data element in the trace stream and determining theprocessing outcome of the MOVNE instruction based on the tracedcondition value included in the trace data element. The diagnosticcircuit 3016 then sets the diagnostic control flag 3028 at step 3110 ofFIG. 23.

Then, for subsequent conditional instructions at memory locations 2008and 200C, the trace circuit 3006 detects that the control flag 3026 isin the set state, and so does not generate a corresponding trace dataelement. In a corresponding way, the diagnostic circuit 16 detects thatthe diagnostic control flag 3028 is in the set state, and so followingsteps 3112 and 3114 of FIG. 23 locates the trace data element associatedwith the previous conditional instruction stored at memory location2004. The diagnostic circuit 3016 determines the processing outcome ofthe instructions at memory locations 2008 and 200C based on the previoustrace data element for the instruction at memory location 2004.

In this way, a trace stream can be generated in which the firstconditional instruction to be executed following an update of thecondition flags 3022 triggers generation of a trace data elementincluding a traced condition value.

FIGS. 25-27 show an embodiment in which the trace circuit 3006 monitorswhich condition flags 3022 have already been traced, and when generatinga trace data element for a conditional instruction traces the additionalcondition flags required by that conditional instruction which have notalready been traced. This method makes use of a plurality of controlflags 3026 each corresponding to a respective one of the condition flags3022. Each control flag 3026 has a “clear” state and a “set” state. Thediagnostic circuit 3016 has a corresponding group of diagnostic controlflags 3028 also having a “clear” state and a “set” state.

FIG. 25 illustrates a method of tracing the operations of the processingcircuit 3004. At step 3140, the processing circuit 3004 executes a nextinstruction and the execution of this instruction is monitored by thetrace circuit 3006. At step 3142, it is determined whether or not theinstruction is a conditional instruction. If the instruction is aconditional instruction, then at step 3144 the trace circuit 3006determines the subset of the condition flags 3022 that is required fordetermining the outcome of the conditional instruction. For example, foreach condition shown in FIG. 16, the corresponding flags indicated inthe table are the required subset of condition flags. The HI condition,for example, requires the C and Z flags.

At step 3146, the trace circuit 3006 determines whether any of thecontrol flags 26 corresponding to the required subset of condition flags3022 are clear. If none of the control flags corresponding to therequired subset of condition flags are clear, then the method proceedsto step 3152. If any one or more of the control flags that correspond tothe required subset of condition flags are clear, then at step 3148 thetrace circuit 3006 generates and outputs a trace data element includinga traced condition value which indicates at least the condition flags3022 of the required subset for which the corresponding control flags3026 are clear. Optionally, the trace condition value may also indicateother condition flags, or may indicate all of the condition flags 3022.Then, at step 3150, the trace circuit 3006 sets the control flagscorresponding to the condition flags that were indicated in the tracedcondition value. If at step 3142, the instruction was determined not tobe a conditional instruction then steps 3144 to 3150 are omitted.

At step 3152, the trace circuit 3006 determines whether or not theinstruction being executed by the processing circuit 4 is a conditionupdating instruction. If the instruction is a condition updatinginstruction then at step 3154 the trace circuit 3006 clears at least thecontrol flags 3026 corresponding to condition flags 3022 that areupdated as a result of the condition updating instruction. Optionally,at step 3154 the trace circuit 3006 may also clear other control flags3026, or may clear all of the control flags 3026. If the instruction isnot a condition updating instruction then step 3154 is omitted. At step3156, it is determined whether or not there is another instruction to beprocessed by the processing circuit 3004. If there is such aninstruction, then the method returns to step 3140. Otherwise, the methodends at step 3158.

Pseudocode for implementing the method of FIG. 25 is indicated below(the term “markers” refers to the control flags 3026):

On an instruction:

-   -   If instruction is conditional:        -   If any markers for flags required by this instruction are            clear:            -   Trace at least the flags required            -   Set markers for the required flags    -   If instruction updates the CPSR:        -   Clear at least the markers for updated flags

Alternatively, the following pseudocode could be used to implement themethod of FIG. 25:

On an instruction:

-   -   If instruction is conditional:        -   If any markers for flags required by this instruction are            clear:            -   Trace at least the flags required            -   Set markers for the traced flags    -   If instruction updates the CPSR:        -   Clear at least the markers for updated flags

FIG. 26 shows a method of analysing the trace stream generated by themethod of FIG. 25. At step 3160, the diagnostic circuit 3016 analyses anext instruction indicated in the indication of the instructionsexecuted by the processing circuit 3004. If at step 3162 it isdetermined that the next instruction is a conditional instruction, thenat step 3164 the diagnostic circuit 3016 determines the required subsetof condition flags for that instruction and determines whether thecorresponding diagnostic control flags 3028 to the required subset ofcondition flags are clear or set. At step 3166, if step 3164 determinedthat any of the diagnostic control flags 3028 corresponding to therequired subset of condition flags were clear, then the diagnosticcircuit 3016 locates in the trace stream an associated trace dataelement including a first traced condition value. The first tracedcondition value indicates at least the values of the required subset ofcondition flags corresponding to clear diagnostic control flags 3028.The diagnostic circuit 3016 then sets the diagnostic control flags 3028that are clear and correspond to a condition flag 3022 of the desiredsubset.

At step 3168, if step 3164 determined that any diagnostic control flags3028 corresponding to the required subset of condition flags were set,then the diagnostic circuit 3016 locates at least one further trace dataelement for at least one previous conditional instruction. The furthertrace data element includes at least one further traced condition valueindicating values of the condition flags corresponding to thosediagnostic control flags that were set. Then, at step 3170 thediagnostic circuit 3016 analyses the first traced condition value and/orthe at least one further traced condition value (defending on whichtraced condition values were accessed at steps 3166 and 3168) and thendetermines the processing outcome of the current conditional instructionbased on those traced condition values. If at step 3162 the instructionwas determined not to be a conditional instruction, then steps 3164 to3170 are omitted.

At step 3172, the diagnostic circuit 3016 determines whether or not thenext indicated instruction is a condition updating instruction. If thenext instruction is a condition updating instruction then at step 3174the diagnostic circuit 3016 clears at least the diagnostic control flags3028 corresponding to condition flags 3022 that were updated as a resultof execution of the condition updating instruction (the diagnosticcircuit 3016 can determine which condition flags 3022 were updated basedon a deduced processing outcome of the condition updating instruction).Optionally, at step 3174 the diagnostic circuit 3016 may also clearother of the diagnostic control flags 3028, or may clear all of thediagnostic control flags 3028. If at step 3172 the next instruction isnot a condition updating instruction, then step 3174 is omitted. At step3176, it is determined whether or not there is another instruction to beanalysed. If there is another instruction then the method returns tostep 3160 while otherwise the method ends at step 3178.

FIG. 27 illustrates an example of the application of the method of FIGS.25 and 3012 to the stream of program instructions illustratedpreviously. In this example, it is assumed that all control flags 3026and diagnostic control flags 3028 are cleared in response to a conditionupdating instruction, but as mentioned above it is also possible toprovide an embodiment in which the trace circuit 3006 and diagnosticcircuit 3016 clear only the control flags 3026, 3028 corresponding tocondition flags 3022 that have been updated.

In FIG. 27, a branch taken result is indicated in the trace data elementgenerated for a branch instruction. The branch taken result can be usedby the diagnostic circuit 3016 to determine which instructions wereexecuted by the processing circuit 3004.

On encountering a condition updating instruction CMP at memory location2000, the trace circuit 3006 clears all the control flags 3026.Similarly, when the diagnostic circuit 3016 encounters the conditionupdating instruction CMP then it clears all of its diagnostic controlflags 3028.

On execution of a conditional instruction MOVNE at memory location 2004,the trace circuit 3006 determines that for the “not equal” condition NEthe required subset of condition flags is the Z flag (see FIG. 16). Atstep 3146 of FIG. 25, the trace circuit 3006 determines that the controlflag 3026 corresponding to the Z condition flag is clear and so at step3148 generates a trace data element including a traced condition valueindicating the value of at least the Z flag. The control flagcorresponding to the Z flag is then set at step 3150 of FIG. 25.

In a corresponding way, when analysing the trace stream the diagnosticcircuit 3016 encounters the conditional instruction MOVNE at memorylocation 2004 and determines that the required subset of condition flagsis the Z flag. At this point, the diagnostic control flag 3028corresponding to the Z condition flag is clear and so the diagnosticcircuit 3016 determines that there is an associated trace data elementcorresponding to the MOVNE instruction. The diagnostic circuit 3016locates the associated trace data element, which includes a tracedcondition value indicating a value of the Z flag. The diagnostic circuit3016 determines the processing outcome based on the traced conditionvalue for the MOVNE instruction stored at memory location 2004. Thediagnostic circuit 3016 then sets the diagnostic control flag 3028corresponding to the Z flag.

When the trace circuit 3006 encounters the conditional instruction MOVEQstored at memory location 2008, the trace circuit 3006 determines thatthe required subset of flags for determining whether the “equals”condition EQ is satisfied is again the Z flag (see FIG. 16). At step3146 of FIG. 25, the trace circuit 3006 determines that the control flagcorresponding to the Z flag is set and so omits steps 3148 and 3150 ofFIG. 25 and does not generate a trace data element including a tracedcondition value. On analysing the trace stream, the diagnostic circuit3016 can similarly detect that the diagnostic control flag 3028corresponding to the Z flag is set. Therefore, the diagnostic circuit3016 will at step 3168 of FIG. 26 locate the trace data element for theprevious conditional instruction MOVNE stored at memory location 2004,and determine the outcome of the MOVEQ instruction based on the tracedcondition value included in the trace data element for the MOVNEinstruction.

At memory location 200C there is a conditional add instruction ADDHIwhich is dependent on the HI condition. When this instruction isexecuted, the trace circuit 3006 determines that the required subset ofcondition flags is the C flag and the Z flag (see FIG. 16). The tracecircuit 3006 determines the status of the corresponding control flags3026 corresponding to the C and Z flags, and determines that the controlflag 3026 corresponding to the Z condition flag is set, but the controlflag 3026 corresponding to the C condition flag is still clear.Therefore, at step 3148 of FIG. 25, the trace circuit 3006 generates atrace data element including at least the value indicating the C flag.The control flag 3026 corresponding to the C condition flag is then set.

On analysing the trace stream, the diagnostic apparatus 3012 detectsthat the required subset of condition flags for the ADDHI instruction atmemory location 200C is the C and Z flags. Since the diagnostic controlflag 3028 corresponding to the C flag is clear, at step 3166 thediagnostic circuit 3016 will locate in the trace stream a trace dataelement associated with the ADDHI instruction that indicates the C flagvalue. At step 3168 of FIG. 26, the diagnostic circuit 3016 will alsolocate a further trace data element, because the diagnostic control flag3028 for the Z condition flag was set at step 3164. In this example, thefurther trace data element is the trace data element generated for theMOVNE instruction at memory location 2004. At step 3170 of FIG. 26, thediagnostic circuit 3016 determines a processing outcome of the ADDHIinstruction based on both the traced condition value included in thetrace data element for the MOVNE instruction at memory location 2004 andthe trace condition value included in the trace data element for theADDHI instruction at memory location 200C.

In a similar way, the trace circuit 6 generates trace data and thediagnostic circuit 16 analyses the trace data for the subsequentinstructions shown in FIG. 27.

While the above embodiments have described the control flags 26 anddiagnostic control flags 3028 being cleared when the condition flags3022 are updated, other events may also trigger the control flags 3026or diagnostic control flags 3028 to be cleared. For example, anexception event may cause the control flags to be cleared. If theexception handler triggered by the exception event is being traced bythe trace circuit 3006, then clearing the control flags 3026 onoccurrence of an exception event ensures that the condition flags 3022will be traced on initiation of the exception handler. Alternatively, ifthe exception handler is not being traced, then clearing the controlflags 3026 on occurrence of the exception event can ensure that thecondition flags 3022 will be traced following a return from exceptionhandling.

Also, the trace circuit 3006 may periodically clear the control flags,so that a traced condition value is included periodically in the tracestream to provide a reference point for the diagnostic apparatus 3012.The diagnostic circuit 3016 can begin analysing the trace data at thereference point, since the traced condition value included at thereference point enables the state of the condition flags to bedetermined without requiring information from previous trace dataelements. This is useful since the diagnostic circuit 3016 is able tojump directly to a region of the trace stream of interest rather thanhaving to work through the entire trace stream to reach the region ofinterest.

Also, to improve processing performance some processors may performspeculative execution of instructions before it is known whether or notthat instruction should actually be executed. Sometimes, one or morespeculatively executed instructions should not in fact have beenexecuted. On detecting a mis-speculation, the processor may reverse theresults of any incorrectly executed instruction to recover the processorstate arising before execution of the incorrectly executed instruction.It may be unknown to the trace circuit 3006 how many instructions wereincorrectly executed. To ensure that the condition flag values resultingfrom correction of the mis-speculation can be determined from the tracestream, the trace circuit 6 may clear the control flags 3026 ondetection of a mis-speculation.

For any of these events, the trace circuit 3006 may include in the tracestream information indicating that the control flags 3026 have beencleared. The diagnostic circuit 3016 may respond to this information byclearing the diagnostic control flags 3028.

FIGS. 22-27 illustrate embodiments in which a traced condition valueindicating values of the condition flags 3022 is included in the tracestream to enable the outcome of a conditional instruction to bedetermined by the diagnostic apparatus 3012. However, these techniquesmay also be applied to embodiments where another kind of outcomeindicating value (for instance, a pass/fail result) is included in thetrace stream to enable the outcome of the conditional instruction to bedetermined.

Although illustrative embodiments of the invention have been describedin detail herein with reference to the accompanying drawings, it is tobe understood that the invention is not limited to those preciseembodiments, and that various changes and modifications can be effectedtherein by one skilled in the art without departing from the scope andspirit of the invention as defined by the appended claims.

We claim:
 1. A trace unit configured to generate items of trace dataindicative of processing activities of a data processing apparatus, saidtrace unit comprising: a trace input interface for receiving from saiddata processing apparatus at least one instruction observed indicatorindicating execution of a conditional instruction and at least oneresult output indicator indicating output by said data processingapparatus of a result of executing said at least one conditionalinstruction; and tracing circuitry for processing said at least oneinstruction observed indicator and said at least one result outputindicator and configured to generate from said at least one instructionobserved indicator and said at least one result output indicatorcorresponding conditional instruction trace data items and conditionalresult trace data items and to independently output said conditionalinstruction trace data items and said conditional result trace dataitems enabling separate trace analysis of conditional instructions andcorresponding conditional results by a diagnostic apparatus; whereinsaid trace unit comprises a result output indicator buffer for storing aplurality of sets of result output indicators received from said dataprocessing apparatus, said trace unit being configured to periodicallyselect a stored set of results for output for processing to said tracingcircuitry and in response to one of said instruction observed indicatorsindicating a conditional instruction referencing a set of result outputindicators that said buffer currently store a valid value for, saidtrace unit is configured to select said currently stored valid set ofresult output indicators for output such that a new set of result outputindicators can be stored.
 2. A trace unit as claimed in claim 1, whereinsaid instruction observed indicator is received at said trace inputinterface in a first processing cycle and said result output indicatoris received at said trace input interface in a second processing cycle,said second processing cycle being different from said first processingcycle.
 3. A trace unit as claimed in claim 2, wherein said trace inputinterface receives from said data processing apparatus, an instructiontag corresponding to said instruction observed indicator and a resulttag corresponding to said result output indicator.
 4. A trace unit asclaimed in claim 3, wherein said instruction tag and said result tag areoutput by said tracing circuitry.
 5. A trace unit as claimed in claim 3,wherein; said data processing apparatus comprises at least one currentprogram status register configured to store a respective set ofcondition code flag marks that are tested to determine whether aconditional instruction should be output and wherein said trace unitcomprises a data store for storing a current program status registertable listing a state associated with said at least one current programstatus register and at least a subset of said respective set ofcondition code flag marks; and said tracing circuitry is configured toperform a tag to key conversion operation in which said instruction tagassociated with said instruction observed indicator is converted to aninstruction key corresponding to said conditional instruction trace dataitem and said result tag associated with said result output indicator isconverted to a result key corresponding to said conditional result tracedata item and wherein said key conversion operation is performeddepending upon said state stored in said current program status registertable.
 6. A trace unit as claimed in claim 5, wherein said tracingcircuitry comprises trace compression circuitry configured to bufferoutput of at least one of said conditional instruction trace data itemscorresponding to a received instruction observed indicator whoseoccurrence can be inferred by said diagnostic apparatus from output bysaid trace unit of a corresponding one of said conditional result tracedata items.
 7. A trace unit as claimed in claim 6, wherein said tracingcircuitry is configured to generate and output one of said result keysfor said buffered conditional instruction trace data item and whereinsaid outputted result key is used by said diagnostic apparatus to inferoutput of said buffered conditional instruction trace data item.
 8. Atrace unit as claimed in claim 6, wherein said tracing circuitry isconfigured to monitor and maintain a buffering record indicating whichof said received instruction observed indicators had output of acorresponding conditional trace data item buffered by said tracingcircuitry.
 9. A trace unit as claimed in claim 8, wherein said bufferingrecord comprises a record of a most recently generated conditionalinstruction trace data item and a most recently output conditionalinstruction trace data item.
 10. A trace unit as claimed in claim 9,wherein a conditional instruction trace data item is determined to havebeen buffered when a key comparison is performed to determine if a keycorresponding to said conditional instruction trace data item is greaterthan a key corresponding to said most recently output conditionalinstruction trace data item and is less than or equal to a keycorresponding to said most recently generated conditional instructiontrace data item.
 11. A trace unit as claimed in claim 9, wherein valuesof said key wrap around when a maximum value is reached and wherein saidkey comparison observes modulo arithmetic.
 12. A trace unit as claimedin claim 5, wherein said tag to key conversion operation is performedsuch that when said trace unit receives one of said instruction observedindicators, said current program status register table is looked upusing said instruction tag to identify an appropriate one of saidcurrent program status registers storing a relevant subset of conditioncode marks.
 13. A trace unit as claimed in claim 12, wherein when saidtracing circuitry performs said tag to key conversion operation byallocating a new key value to a newly generated conditional instructiontrace data item when none of said relevant subset of condition codemarks stored in said current program status register table indicate thatthey are to be traced and allocating a repetitive key value that repeatsa most recently allocated key value to a newly generated conditionalinstruction trace data item when one or more of said subset of conditioncode marks stored in said current program status register table indicatethat they are to be traced.
 14. A trace unit as claimed in claim 13,wherein said tracing circuitry comprises trace compression circuitryconfigured to buffer output of at least one of said conditionalinstruction trace data items having said new key values whose occurrencecan be inferred by said diagnostic apparatus from output by said traceunit of a corresponding one or more of said conditional result tracedata items and wherein conditional instruction trace data itemscorresponding to said repetitive key values are not buffered.
 15. Atrace unit as claimed in claim 14, wherein said tracing circuitry isconfigured to supply said conditional result trace data items to saiddiagnostic apparatus with an indication of whether or not thecorresponding one or more conditional instruction trace data items arepermitted to be inferred by said diagnostic apparatus.
 16. A trace unitas claimed in claim 15, wherein when said one or more conditionalinstruction trace data items are inferred from corresponding conditionalresult trace data items supplied to said diagnostic apparatus, said oneor more conditional instruction trace data items are removed from saidbuffer of said trace compression circuitry and are not output by saidtracing circuitry.
 17. A trace unit a claimed in claim 14, wherein saidone or more conditional instruction trace data items are permitted to beinferred if a corresponding conditional result key is the same as aconditional instruction key currently buffered by said buffer of saidtrace compression circuitry.
 18. A trace unit as claimed in claim 13,wherein said tracing circuitry is configured to receive from said traceinput interface, trace data relating to conditional or non-conditionalbranch instructions and load/store instructions and wherein said tracingcircuitry is configured to generate a first type of waypoint indicatordenoting that a corresponding instruction corresponds to either a takenconditional or non-conditional branch or a load/store instruction and asecond type of waypoint indicator denoting that a correspondinginstruction corresponds to a not taken conditional branch; and saidinstruction observed indicator is used by said data processing apparatusto indicate execution of a conditional instruction other than aconditional branch instruction and wherein said tracing circuitry isconfigured to output a conditional instruction trace data itemcorresponding to said instruction observed indicator and at least one ofsaid first type of waypoint indicator and said second type of waypointindicator in a same trace data stream and said tracing circuitry isconfigured to output a first type of conditional instruction trace dataitem corresponding to conditional instructions other than conditionalbranches where a corresponding instruction key is said repetitive keyvalue and a second type of conditional instruction trace datacorresponding to conditional instructions other than conditionalbranches where a corresponding instruction key is said new key value.19. A trace unit as claimed in claim 13, wherein said tracing circuitryis configured to receive from said trace input interface, trace datarelating to conditional or non-conditional branch instructions andload/store instructions and wherein said tracing circuitry is configuredto generate a first type of waypoint indicator denoting that acorresponding instruction corresponds to either a taken conditional ornon-conditional branch or a load/store instruction and a second type ofwaypoint indicator denoting that a corresponding instruction correspondsto a not taken conditional branch; and said result output indicator isused by said data processing apparatus to indicate execution of aconditional instruction other than a conditional branch instruction andwherein said tracing circuitry is configured to output a conditionalresult trace data item corresponding to said result output indicator andat least one of said first type of waypoint indicator and said secondtype of waypoint indicator in a same trace data stream and said tracingcircuitry is configured to output a first type of conditionalinstruction trace data item corresponding to conditional branches wherea corresponding instruction key is said repetitive key value and asecond type of conditional instruction trace data corresponding toconditional branches where a corresponding instruction key is said newkey value.
 20. A trace unit according to claim 1, wherein said dataprocessing apparatus comprises a plurality of current program statusregisters configured to store a respective set of condition code flagvalues that are indicative of how a conditional instruction isprocessed, said buffer comprising a storage location for storing one setof result output indicators corresponding to each of said plurality ofcurrent program status registers, each of said sets of result outputindicators comprising at least some of said condition code flag values.21. A trace unit according to claim 1, further comprising trace resultcombining circuitry for receiving said conditional result trace dataitems generated by said tracing circuitry and for generating acompressed representation of at least some of said conditional resulttrace data items and storing said compressed representations, andcombining at least some of said compressed representations such thatmultiple compressed representations of trace data items are output ascombined trace data items.
 22. A trace unit according to claim 21,wherein said trace result combining circuitry is configured to generateand store said compressed representations and on receipt of aconditional result trace data item that cannot be compressed by saidtrace result combining circuitry to output said stored compressedrepresentations of trace data items as combined trace data items andthen to output said conditional result trace data item that cannot becompressed.
 23. A trace unit as claimed in claim 1, wherein said tracingcircuitry is configured to concatenate a plurality of said conditionalinstruction trace data items to form a concatenated conditionalinstruction trace data item and to output said concatenated conditionalinstruction trace data item to said diagnostic apparatus instead ofoutputting said plurality of conditional instruction trace data items.24. A trace unit as claimed in claim 23, wherein said concatenatedconditional instruction trace data item has a reduced trace bandwidthrelative to said plurality of said conditional instruction trace dataitems.
 25. A trace unit configured to generate items of trace dataindicative of processing activities of a data processing apparatus, saidtrace unit comprising: a trace input interface for receiving from saiddata processing apparatus at least one instruction observed indicatorindicating execution of a conditional instruction and at least oneresult output indicator indicating output by said data processingapparatus of a result of executing said at least one conditionalinstruction; and tracing circuitry for processing said at least oneinstruction observed indicator and said at least one result outputindicator and configured to generate from said at least one instructionobserved indicator and said at least one result output indicatorcorresponding conditional instruction trace data items and conditionalresult trace data items and to independently output said conditionalinstruction trace data items and said conditional result trace dataitems enabling separate trace analysis of conditional instructions andcorresponding conditional results by a diagnostic apparatus; whereinsaid data processing apparatus comprises at least one current programstatus register configured to store a respective set of condition codeflag marks that are tested to determine whether a conditionalinstruction should be output as said items of trace data and whereinsaid trace unit comprises a data store for storing a current programstatus register table listing a state associated with said at least onecurrent program status register and at least a subset of said respectiveset of condition code flag marks.
 26. A trace unit as claimed in claim25, wherein said current program status register table is configured tostore three different states in respect of each of said subset ofcondition code flags.
 27. A trace unit as claimed in claim 26, whereinsaid three different states comprise: traced; to be traced; and nottraced.
 28. A trace unit as claimed in claim 25, wherein said threedifferent states are tracked by maintaining an in-flight table havingtwo states for each flag of each CPSR indicating which flags should betraced when emitted by said data processing apparatus and a current CPSRtable storing at least two states for each flag of a current CPSRindicating whether or not a conditional instruction is to be traced as aconditional instruction trace data item.
 29. A trace unit as claimed inclaim 25, wherein said tracing circuitry uses said current programstatus register table to determine when said conditional result tracedata items are required and which of said set of condition code flagsshould be traced.
 30. A trace unit as claimed in claim 25, wherein saidconditional instruction trace data items are generated for a subset ofsaid at least one instruction observed indicators depending uponcontents of said current program status register table.
 31. A trace unitconfigured to generate items of trace data indicative of processingactivities of a data processing apparatus, said trace unit comprising: atrace input interface for receiving from said data processing apparatusat least one instruction observed indicator indicating execution of aconditional instruction and at least one result output indicatorindicating output by said data processing apparatus of a result ofexecuting said at least one conditional instruction; and tracingcircuitry for processing said at least one instruction observedindicator and said at least one result output indicator and configuredto generate from said at least one instruction observed indicator andsaid at least one result output indicator corresponding conditionalinstruction trace data items and conditional result trace data items andto independently output said conditional instruction trace data itemsand said conditional result trace data items enabling separate traceanalysis of conditional instructions and corresponding conditionalresults by a diagnostic apparatus; wherein said tracing circuitry isconfigured to receive from said trace input interface, trace datarelating to conditional or non-conditional branch instructions andload/store instructions and wherein said tracing circuitry is configuredto generate a first type of waypoint indicator denoting that acorresponding instruction corresponds to either a taken conditional ornon-conditional branch or a load/store instruction and a second type ofwaypoint indicator denoting that a corresponding instruction correspondsto a not taken conditional branch.
 32. A trace unit as claimed in claim31, wherein said instruction observed indicator is used by said dataprocessing apparatus to indicate execution of a conditional instructionother than a conditional branch instruction and wherein said tracingcircuitry is configured to output a conditional instruction trace dataitem corresponding to said instruction observed indicator and at leastone of said first type of waypoint indicator and said second type ofwaypoint indicator in a same trace data stream.
 33. A trace unit asclaimed in claim 31, wherein said result output indicator is used bysaid data processing apparatus to indicate execution of a conditionalinstruction other than a conditional branch instruction and wherein saidtracing circuitry is configured to output a conditional result tracedata item corresponding to said result output indicator and at least oneof said first type of waypoint indicator and said second type ofwaypoint indicator in a same trace data stream.
 34. A trace unit asclaimed in claim 31, wherein said instruction observed indicator is usedby said data processing apparatus to indicate execution of a conditionalbranch instruction and said result output indicator is used by said dataprocessing apparatus to indicate execution of a conditional instructionother than a conditional branch instruction and wherein said tracingcircuitry is configured to output a conditional instruction trace dataitem corresponding to said instruction observed indicator, a conditionalresult trace data item corresponding to said result output indicator andat least one of said first type of waypoint indicator and said secondtype of waypoint indicator in a same trace data stream.
 35. A trace unitas claimed in claim 31, wherein said tracing circuitry is configured toconcatenate a plurality of waypoint indicators to form a concatenatedwaypoint indicator for output to said diagnostic apparatus, saidconcatenated waypoint indicator comprising one of: a plurality of saidfirst type of waypoint indicators; a plurality of said second type ofwaypoint indicators; and a combination of different types of waypointindicators comprising at least one of said first type of waypointindicator and at least one of said second type of waypoint indicator.36. A trace unit configured to generate items of trace data indicativeof processing activities of a data processing apparatus, said trace unitcomprising: a trace input interface for receiving from said dataprocessing apparatus at least one instruction observed indicatorindicating execution of a conditional instruction and at least oneresult output indicator indicating output by said data processingapparatus of a result of executing said at least one conditionalinstruction; and tracing circuitry for processing said at least oneinstruction observed indicator and said at least one result outputindicator and configured to generate from said at least one instructionobserved indicator and said at least one result output indicatorcorresponding conditional instruction trace data items and conditionalresult trace data items and to independently output said conditionalinstruction trace data items and said conditional result trace dataitems enabling separate trace analysis of conditional instructions andcorresponding conditional results by a diagnostic apparatus; whereinsaid tracing circuitry is configured to receive from said trace inputinterface, trace data relating to conditional or non-conditional branchinstructions and load/store instructions and wherein said tracingcircuitry is configured to generate a first type of waypoint indicatordenoting that a corresponding instruction corresponds to a conditionalbranch predicted to be taken, a non-conditional branch predicted to betaken or a load/store instruction and a second type of waypointindicator denoting that a corresponding instruction is predicted to be anot-taken conditional branch.
 37. A trace unit configured to generateitems of trace data indicative of processing activities of a dataprocessing apparatus, said trace unit comprising: a trace inputinterface for receiving from said data processing apparatus at least oneinstruction observed indicator indicating execution of a conditionalinstruction and at least one result output indicator indicating outputby said data processing apparatus of a result of executing said at leastone conditional instruction; and tracing circuitry for processing saidat least one instruction observed indicator and said at least one resultoutput indicator and configured to generate from said at least oneinstruction observed indicator and said at least one result outputindicator corresponding conditional instruction trace data items andconditional result trace data items and to independently output saidconditional instruction trace data items and said conditional resulttrace data items enabling separate trace analysis of conditionalinstructions and corresponding conditional results by a diagnosticapparatus; wherein said tracing circuitry is configured to concatenate aplurality of said conditional instruction trace data items to form aconcatenated conditional instruction trace data item and to output saidconcatenated conditional instruction trace data item to said diagnosticapparatus instead of outputting said plurality of conditionalinstruction trace data items; wherein said concatenated conditionalinstruction trace data item has a reduced trace bandwidth relative tosaid plurality of said conditional instruction trace data items; andsaid tracing circuitry is configured to output at least one of saidconcatenated conditional instruction trace data items and at least oneof said concatenated waypoint indicators in a same trace data stream.38. A trace unit configured to generate items of trace data indicativeof processing activities of a data processing apparatus, said trace unitcomprising: a trace input interface for receiving from said dataprocessing apparatus at least one instruction observed indicatorindicating execution of a conditional instruction and at least oneresult output indicator indicating output by said data processingapparatus of a result of executing said at least one conditionalinstruction; and tracing circuitry for processing said at least oneinstruction observed indicator and said at least one result outputindicator and configured to generate from said at least one instructionobserved indicator and said at least one result output indicatorcorresponding conditional instruction trace data items and conditionalresult trace data items and to independently output said conditionalinstruction trace data items and said conditional result trace dataitems enabling separate trace analysis of conditional instructions andcorresponding conditional results by a diagnostic apparatus; whereinsaid tracing circuitry is configured to output a realignment trace data.39. A trace unit as claimed in claim 38, wherein said realignment tracedata item is output in response to receipt from said data processingapparatus to a branch mispredict indicator.
 40. A trace unit as claimedin claim 38, wherein said realignment trace data item is output inresponse to receipt from said data processing apparatus to an abortindicator.
 41. A trace unit as claimed in claim 38, wherein saidrealignment trace data item is output in response to receipt from saiddata processing apparatus to an exception indicator.
 42. A trace unit asclaimed in claim 41, wherein said tracing circuitry is configured toreceive from said trace input interface, trace data relating toconditional branch instructions and load/store instructions and whereinsaid tracing circuitry is configured to generate a waypoint indicatordenoting that a corresponding instruction corresponds to either aconditional branch or a load/store instruction and wherein saidinstruction observed indicator is used by said data processing apparatusto indicate execution of a conditional instruction other than aconditional branch instruction and wherein said tracing circuitry isconfigured to output a conditional instruction trace data itemassociated with said instruction observed indicator and said waypointindicator in a same trace data stream and wherein said tracing circuitryis configured to output said realignment trace data item in response tosaid exception indicator such that said realignment trace data item isoutput after receipt of said exception indicator but before output of asubsequently occurring conditional instruction trace data item orwaypoint indicator.
 43. A trace unit as claimed in claim 38, whereinsaid realignment trace data item is output in response to receipt fromsaid data processing apparatus to a cancel indicator.
 44. A trace unitas claimed in claim 38, wherein said tracing circuitry is configured tooutput any conditional instruction trace data items that have beenreceived but not yet output prior to output of said realignment tracedata item.
 45. A trace unit as claimed in claim 38, wherein said tracingcircuitry is configured to output any waypoint trace data items thathave been received but not yet output prior to output of saidrealignment trace data item.
 46. A trace unit as claimed in claim 38,wherein said tracing circuitry is configured to receive from said traceinput interface, trace data relating to conditional branch instructionsand load/store instructions and wherein said tracing circuitry isconfigured to generate a waypoint indicator denoting that acorresponding instruction corresponds to either a conditional branch ora load/store instruction and wherein said instruction observed indicatoris used by said data processing apparatus to indicate execution of aconditional instruction other than a conditional branch instruction andwherein said tracing circuitry is configured to output said conditionalinstruction trace data item associated with said instruction observedindicator and to output said waypoint indicator in a same trace datastream and wherein said tracing circuitry is configured to output saidrealignment trace data item in response to said branch mispredictindicator such that said realignment trace data item is output afterreceipt of said branch mispredict indicator but before output of asubsequently occurring conditional instruction trace data item orwaypoint indicator.
 47. A trace unit configured to generate items oftrace data indicative of processing activities of a data processingapparatus, said trace unit comprising: a trace input interface forreceiving from said data processing apparatus at least one instructionobserved indicator indicating execution of a conditional instruction andat least one result output indicator indicating output by said dataprocessing apparatus of a result of executing said at least oneconditional instruction; and tracing circuitry for processing said atleast one instruction observed indicator and said at least one resultoutput indicator and configured to generate from said at least oneinstruction observed indicator and said at least one result outputindicator corresponding conditional instruction trace data items andconditional result trace data items and to independently output saidconditional instruction trace data items and said conditional resulttrace data items enabling separate trace analysis of conditionalinstructions and corresponding conditional results by a diagnosticapparatus; wherein said tracing circuitry is configured to receive fromsaid data processing apparatus a cancellation indication indicating thatone or more speculatively executed and traced instructions have beencancelled and wherein said tracing circuitry is configured to generatein response to said cancellation indication a realignment trace item,said realignment trace item being output by said tracing circuitry toinform said diagnostic apparatus that at least one previously receivedconditional instruction trace item should be discarded.
 48. A diagnosticapparatus configured to receive a trace data stream comprisingconditional instruction trace data items and conditional result tracedata items wherein said conditional result trace data items are separatefrom said conditional instruction trace data items in said receivedtrace data stream, said diagnostic apparatus comprising: diagnosticcircuitry configured to process said conditional instruction trace dataitems and said conditional result trace data items with reference to animage of program instructions executed by said data processing apparatusin order to generate said trace data stream, said diagnostic circuitrybeing configured to use said image of program instructions, conditionalinstruction trace data items and said conditional result trace dataitems to determine program instructions executed by said data processingapparatus; wherein the diagnostic apparatus is configured to receivefrom a trace unit in a trace data stream, waypoint trace items eachindicating that one of a branch instruction, a load instruction and astore instruction has been executed by said data processing apparatussaid trace data stream additionally comprising said conditionalinstruction trace items and said conditional result trace items andwherein a received ordering of said waypoint trace items and conditionalinstruction trace data items differs from an execution ordering ofcorresponding waypoint instructions and conditional instructions.
 49. Adiagnostic apparatus as claimed in claim 48, wherein said diagnosticapparatus comprises a waypoint buffer for buffering said receivedwaypoint trace items and a conditional instruction buffer for bufferingsaid received conditional instruction trace items.
 50. A diagnosticapparatus as claimed in claim 49, wherein said diagnostic circuitry isconfigured to permute said received ordering to obtain said executionordering by independently analysing entries in said waypoint buffer andentries in said conditional instruction buffer with reference to saidprogram instruction image.
 51. A diagnostic apparatus as claimed inclaim 49, wherein if said diagnostic circuitry encounters a conditionalinstruction in said program image but a conditional instruction traceitem is not currently present in said conditional instruction bufferthen said diagnostic circuitry is configured to delay further processingof a corresponding execution thread of said program image until saidconditional trace item appears in said conditional instruction buffer.52. A method of generating items of trace data indicative of processingactivities of a data processing apparatus based on information receivedfrom said data processing apparatus, said method comprising: receivingfrom said data processing apparatus at least one instruction observedindicator indicating execution of a conditional instruction and at leastone result output indicator indicating output by said data processingapparatus of a result of executing said at least one conditionalinstruction; and processing said at least one instruction observedindicator and said at least one result output indicator and configuredto generate from said at least one instruction observed indicator andsaid at least one result output indicator corresponding conditionalinstruction trace data items and conditional result trace data items andto independently output said conditional instruction trace data itemsand said conditional result trace data items enabling separate traceanalysis of conditional instructions and corresponding conditionalresults by a diagnostic apparatus; storing a plurality of sets of resultoutput indicators received from said data processing apparatus in abuffer; and periodically selecting a stored set of results for outputfor processing to said tracing circuitry, and in response to one of saidinstruction observed indicators indicating a conditional instructionreferencing a set of result output indicators that said buffer currentlystore a valid value for, selecting said currently stored valid set ofresult output indicators for output such that a new set of result outputindicators can be stored.
 53. The method as claimed in claim 52, whereinsaid instruction observed indicator is received in a first processingcycle and said result output indicator is received in a secondprocessing cycle, said second processing cycle being different from saidfirst processing cycle.
 54. A diagnostic method for processing tracedata generated by a data processing apparatus, said method comprising:receiving a trace data stream comprising conditional instruction tracedata items and conditional result trace data items wherein saidconditional result trace data items are separate from said conditionalinstruction trace data items in said received trace data stream;processing said conditional instruction trace data items and saidconditional result trace data items with reference to an image ofprogram instructions executed by said data processing apparatus in orderto generate said trace data stream; using said image of programinstructions to perform a correlation between said conditionalinstruction trace data items and said conditional result trace dataitems to determine processing steps performed by said data processingapparatus; and wherein the receiving step receives in the trace datastream, waypoint trace items each indicating that one of a branchinstruction, a load instruction and a store instruction has beenexecuted by said data processing apparatus, said trace data streamadditionally comprising said conditional instruction trace items andsaid conditional result trace items and wherein a received ordering ofsaid waypoint trace items and conditional instruction trace data itemsdiffers from an execution ordering of corresponding waypointinstructions and conditional instructions.
 55. A trace unit configuredto generate items of trace data indicative of processing activities of adata processing apparatus, said trace unit comprising: means forreceiving from said data processing apparatus at least one instructionobserved indicator indicating execution of a conditional instruction andat least one result output indicator indicating output by said dataprocessing apparatus of a result of executing said at least oneconditional instruction; and means for processing said at least oneinstruction observed indicator and said at least one result outputindicator and configured to generate from said at least one instructionobserved indicator and said at least one result output indicatorcorresponding conditional instruction trace data items and conditionalresult trace data items and to independently output said conditionalinstruction trace data items and said conditional result trace dataitems enabling separate trace analysis of conditional instructions andcorresponding conditional results by a diagnostic apparatus; whereinsaid trace unit comprises a result output indicator buffer means forstoring a plurality of sets of result output indicators received fromsaid data processing apparatus, said trace unit being configured toperiodically select a stored set of results for output for processing tosaid means for processing and in response to one of said instructionobserved indicators indicating a conditional instruction referencing aset of result output indicators that said buffer means currently store avalid value for, said trace unit is configured to select said currentlystored valid set of result output indicators for output such that a newset of result output indicators can be stored.
 56. A diagnosticapparatus configured to receive a trace data stream comprisingconditional instruction trace data items and conditional result tracedata items wherein said conditional result trace data items are separatefrom said conditional instruction trace data items in said receivedtrace data stream, said diagnostic apparatus comprising: means forprocessing said conditional instruction trace data items and saidconditional result trace data items with reference to an image ofprogram instructions executed by said data processing apparatus in orderto generate said trace data stream, said means for processing beingconfigured to use said image of program instructions, conditionalinstruction trace data items and said conditional result trace dataitems to determine program instructions executed by said data processingapparatus; wherein the diagnostic apparatus is configured to receivefrom a trace unit in a trace data stream, waypoint trace items eachindicating that one of a branch instruction, a load instruction and astore instruction has been executed by said data processing apparatussaid trace data stream additionally comprising said conditionalinstruction trace items and said conditional result trace items andwherein a received ordering of said waypoint trace items and conditionalinstruction trace data items differs from an execution ordering ofcorresponding waypoint instructions and conditional instructions.